00:00:00.000 Started by upstream project "autotest-nightly" build number 3625 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3007 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.036 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-cvl-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.037 The recommended git tool is: git 00:00:00.037 using credential 00000000-0000-0000-0000-000000000002 00:00:00.038 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-cvl-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.051 Fetching changes from the remote Git repository 00:00:00.053 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.090 Using shallow fetch with depth 1 00:00:00.090 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.090 > git --version # timeout=10 00:00:00.161 > git --version # 'git version 2.39.2' 00:00:00.162 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.163 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.163 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:03.113 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:03.126 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:03.138 Checking out Revision c38b93df03fb3fd90b2ba7d165084f104cec2d9b (FETCH_HEAD) 00:00:03.138 > git config core.sparsecheckout # timeout=10 00:00:03.154 > git read-tree -mu HEAD # timeout=10 00:00:03.170 > git checkout -f c38b93df03fb3fd90b2ba7d165084f104cec2d9b # timeout=5 00:00:03.189 Commit message: "packer: Bump BESClient to latest available version" 00:00:03.190 > git rev-list --no-walk 3fbc5c0ceee15b3cc82c7e28355dfd4637aa6338 # timeout=10 00:00:03.283 [Pipeline] Start of Pipeline 00:00:03.297 [Pipeline] library 00:00:03.298 Loading library shm_lib@master 00:00:03.298 Library shm_lib@master is cached. Copying from home. 00:00:03.310 [Pipeline] node 00:00:03.315 Running on WFP38 in /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:00:03.316 [Pipeline] { 00:00:03.328 [Pipeline] catchError 00:00:03.329 [Pipeline] { 00:00:03.338 [Pipeline] wrap 00:00:03.345 [Pipeline] { 00:00:03.353 [Pipeline] stage 00:00:03.354 [Pipeline] { (Prologue) 00:00:03.509 [Pipeline] sh 00:00:03.804 + logger -p user.info -t JENKINS-CI 00:00:03.823 [Pipeline] echo 00:00:03.824 Node: WFP38 00:00:03.831 [Pipeline] sh 00:00:04.129 [Pipeline] setCustomBuildProperty 00:00:04.137 [Pipeline] echo 00:00:04.138 Cleanup processes 00:00:04.142 [Pipeline] sh 00:00:04.424 + sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:04.424 383770 sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:04.436 [Pipeline] sh 00:00:04.721 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:00:04.721 ++ grep -v 'sudo pgrep' 00:00:04.721 ++ awk '{print $1}' 00:00:04.721 + sudo kill -9 00:00:04.721 + true 00:00:04.736 [Pipeline] cleanWs 00:00:04.745 [WS-CLEANUP] Deleting project workspace... 00:00:04.745 [WS-CLEANUP] Deferred wipeout is used... 00:00:04.753 [WS-CLEANUP] done 00:00:04.757 [Pipeline] setCustomBuildProperty 00:00:04.768 [Pipeline] sh 00:00:05.059 + sudo git config --global --replace-all safe.directory '*' 00:00:05.135 [Pipeline] nodesByLabel 00:00:05.136 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.143 [Pipeline] httpRequest 00:00:05.147 HttpMethod: GET 00:00:05.147 URL: http://10.211.164.96/packages/jbp_c38b93df03fb3fd90b2ba7d165084f104cec2d9b.tar.gz 00:00:05.157 Sending request to url: http://10.211.164.96/packages/jbp_c38b93df03fb3fd90b2ba7d165084f104cec2d9b.tar.gz 00:00:05.171 Response Code: HTTP/1.1 200 OK 00:00:05.171 Success: Status code 200 is in the accepted range: 200,404 00:00:05.172 Saving response body to /var/jenkins/workspace/nvmf-cvl-phy-autotest/jbp_c38b93df03fb3fd90b2ba7d165084f104cec2d9b.tar.gz 00:00:07.621 [Pipeline] sh 00:00:07.905 + tar --no-same-owner -xf jbp_c38b93df03fb3fd90b2ba7d165084f104cec2d9b.tar.gz 00:00:07.922 [Pipeline] httpRequest 00:00:07.925 HttpMethod: GET 00:00:07.926 URL: http://10.211.164.96/packages/spdk_3f2c8979187809f9b3b0766ead4b91dc70fd73c6.tar.gz 00:00:07.927 Sending request to url: http://10.211.164.96/packages/spdk_3f2c8979187809f9b3b0766ead4b91dc70fd73c6.tar.gz 00:00:07.943 Response Code: HTTP/1.1 200 OK 00:00:07.944 Success: Status code 200 is in the accepted range: 200,404 00:00:07.944 Saving response body to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk_3f2c8979187809f9b3b0766ead4b91dc70fd73c6.tar.gz 00:01:21.107 [Pipeline] sh 00:01:21.399 + tar --no-same-owner -xf spdk_3f2c8979187809f9b3b0766ead4b91dc70fd73c6.tar.gz 00:01:23.953 [Pipeline] sh 00:01:24.240 + git -C spdk log --oneline -n5 00:01:24.240 3f2c89791 event: switch reactors to poll mode before stopping 00:01:24.240 443e1ea31 setup.sh: emit command line to /dev/kmsg on Linux 00:01:24.240 a1264177c pkgdep/git: Adjust ICE driver to kernel >= 6.8.x 00:01:24.240 af95268b1 pkgdep/git: Adjust QAT driver to kernel >= 6.8.x 00:01:24.240 5e75b9137 scripts/pkgdep: Simplify mdl installation 00:01:24.254 [Pipeline] } 00:01:24.272 [Pipeline] // stage 00:01:24.281 [Pipeline] stage 00:01:24.283 [Pipeline] { (Prepare) 00:01:24.304 [Pipeline] writeFile 00:01:24.324 [Pipeline] sh 00:01:24.610 + logger -p user.info -t JENKINS-CI 00:01:24.625 [Pipeline] sh 00:01:24.912 + logger -p user.info -t JENKINS-CI 00:01:24.925 [Pipeline] sh 00:01:25.211 + cat autorun-spdk.conf 00:01:25.211 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.211 SPDK_TEST_NVMF=1 00:01:25.211 SPDK_TEST_NVME_CLI=1 00:01:25.211 SPDK_TEST_NVMF_TRANSPORT=rdma 00:01:25.211 SPDK_TEST_NVMF_NICS=e810 00:01:25.211 SPDK_RUN_UBSAN=1 00:01:25.211 NET_TYPE=phy 00:01:25.219 RUN_NIGHTLY=1 00:01:25.224 [Pipeline] readFile 00:01:25.249 [Pipeline] withEnv 00:01:25.252 [Pipeline] { 00:01:25.266 [Pipeline] sh 00:01:25.552 + set -ex 00:01:25.552 + [[ -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf ]] 00:01:25.552 + source /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf 00:01:25.552 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.552 ++ SPDK_TEST_NVMF=1 00:01:25.552 ++ SPDK_TEST_NVME_CLI=1 00:01:25.552 ++ SPDK_TEST_NVMF_TRANSPORT=rdma 00:01:25.552 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.552 ++ SPDK_RUN_UBSAN=1 00:01:25.552 ++ NET_TYPE=phy 00:01:25.552 ++ RUN_NIGHTLY=1 00:01:25.552 + case $SPDK_TEST_NVMF_NICS in 00:01:25.552 + DRIVERS=ice 00:01:25.552 + [[ rdma == \r\d\m\a ]] 00:01:25.552 + DRIVERS+=' irdma' 00:01:25.552 + [[ -n ice irdma ]] 00:01:25.552 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:25.552 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:25.552 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:25.552 rmmod: ERROR: Module i40iw is not currently loaded 00:01:25.552 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:25.552 + true 00:01:25.552 + for D in $DRIVERS 00:01:25.552 + sudo modprobe ice 00:01:25.552 + for D in $DRIVERS 00:01:25.552 + sudo modprobe irdma 00:01:25.812 + exit 0 00:01:25.822 [Pipeline] } 00:01:25.846 [Pipeline] // withEnv 00:01:25.852 [Pipeline] } 00:01:25.869 [Pipeline] // stage 00:01:25.880 [Pipeline] catchError 00:01:25.882 [Pipeline] { 00:01:25.900 [Pipeline] timeout 00:01:25.901 Timeout set to expire in 40 min 00:01:25.903 [Pipeline] { 00:01:25.918 [Pipeline] stage 00:01:25.921 [Pipeline] { (Tests) 00:01:25.937 [Pipeline] sh 00:01:26.225 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:01:26.225 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:01:26.225 + DIR_ROOT=/var/jenkins/workspace/nvmf-cvl-phy-autotest 00:01:26.225 + [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest ]] 00:01:26.225 + DIR_SPDK=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:26.225 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-cvl-phy-autotest/output 00:01:26.225 + [[ -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk ]] 00:01:26.225 + [[ ! -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/output ]] 00:01:26.225 + mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/output 00:01:26.225 + [[ -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/output ]] 00:01:26.225 + cd /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:01:26.225 + source /etc/os-release 00:01:26.225 ++ NAME='Fedora Linux' 00:01:26.225 ++ VERSION='38 (Cloud Edition)' 00:01:26.225 ++ ID=fedora 00:01:26.225 ++ VERSION_ID=38 00:01:26.226 ++ VERSION_CODENAME= 00:01:26.226 ++ PLATFORM_ID=platform:f38 00:01:26.226 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:26.226 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:26.226 ++ LOGO=fedora-logo-icon 00:01:26.226 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:26.226 ++ HOME_URL=https://fedoraproject.org/ 00:01:26.226 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:26.226 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:26.226 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:26.226 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:26.226 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:26.226 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:26.226 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:26.226 ++ SUPPORT_END=2024-05-14 00:01:26.226 ++ VARIANT='Cloud Edition' 00:01:26.226 ++ VARIANT_ID=cloud 00:01:26.226 + uname -a 00:01:26.226 Linux spdk-wfp-38 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 02:47:10 UTC 2024 x86_64 GNU/Linux 00:01:26.226 + sudo /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:01:28.767 Hugepages 00:01:28.767 node hugesize free / total 00:01:28.767 node0 1048576kB 0 / 0 00:01:28.767 node0 2048kB 0 / 0 00:01:28.767 node1 1048576kB 0 / 0 00:01:28.767 node1 2048kB 0 / 0 00:01:28.767 00:01:28.767 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:28.767 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:01:28.767 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:01:29.026 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:01:29.026 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:01:29.026 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:01:29.026 + rm -f /tmp/spdk-ld-path 00:01:29.026 + source autorun-spdk.conf 00:01:29.026 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.026 ++ SPDK_TEST_NVMF=1 00:01:29.026 ++ SPDK_TEST_NVME_CLI=1 00:01:29.026 ++ SPDK_TEST_NVMF_TRANSPORT=rdma 00:01:29.026 ++ SPDK_TEST_NVMF_NICS=e810 00:01:29.026 ++ SPDK_RUN_UBSAN=1 00:01:29.026 ++ NET_TYPE=phy 00:01:29.026 ++ RUN_NIGHTLY=1 00:01:29.026 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:29.026 + [[ -n '' ]] 00:01:29.026 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:29.026 + for M in /var/spdk/build-*-manifest.txt 00:01:29.026 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:29.026 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/output/ 00:01:29.026 + for M in /var/spdk/build-*-manifest.txt 00:01:29.026 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:29.026 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/output/ 00:01:29.026 ++ uname 00:01:29.026 + [[ Linux == \L\i\n\u\x ]] 00:01:29.026 + sudo dmesg -T 00:01:29.026 + sudo dmesg --clear 00:01:29.287 + dmesg_pid=384757 00:01:29.287 + [[ Fedora Linux == FreeBSD ]] 00:01:29.287 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.287 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.287 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:29.287 + [[ -x /usr/src/fio-static/fio ]] 00:01:29.287 + sudo dmesg -Tw 00:01:29.287 + export FIO_BIN=/usr/src/fio-static/fio 00:01:29.287 + FIO_BIN=/usr/src/fio-static/fio 00:01:29.287 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\c\v\l\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:29.287 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:29.287 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:29.287 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.287 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.287 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:29.287 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.287 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.287 + spdk/autorun.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest/autorun-spdk.conf 00:01:29.287 Test configuration: 00:01:29.287 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.287 SPDK_TEST_NVMF=1 00:01:29.287 SPDK_TEST_NVME_CLI=1 00:01:29.287 SPDK_TEST_NVMF_TRANSPORT=rdma 00:01:29.287 SPDK_TEST_NVMF_NICS=e810 00:01:29.287 SPDK_RUN_UBSAN=1 00:01:29.287 NET_TYPE=phy 00:01:29.287 RUN_NIGHTLY=1 15:02:33 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:01:29.287 15:02:33 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:29.287 15:02:33 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:29.287 15:02:33 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:29.287 15:02:33 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.287 15:02:33 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.287 15:02:33 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.287 15:02:33 -- paths/export.sh@5 -- $ export PATH 00:01:29.287 15:02:33 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.287 15:02:33 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:01:29.287 15:02:33 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:29.287 15:02:33 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713963753.XXXXXX 00:01:29.287 15:02:33 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713963753.z4WQdO 00:01:29.287 15:02:33 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:29.287 15:02:33 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:29.287 15:02:33 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/' 00:01:29.287 15:02:33 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:29.287 15:02:33 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:29.287 15:02:33 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:29.287 15:02:33 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:01:29.287 15:02:33 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.287 15:02:33 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:29.287 15:02:33 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:01:29.287 15:02:33 -- pm/common@17 -- $ local monitor 00:01:29.287 15:02:33 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.287 15:02:33 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=384791 00:01:29.287 15:02:33 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.287 15:02:33 -- pm/common@21 -- $ date +%s 00:01:29.287 15:02:33 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=384793 00:01:29.287 15:02:33 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.287 15:02:33 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=384796 00:01:29.287 15:02:33 -- pm/common@21 -- $ date +%s 00:01:29.287 15:02:33 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.287 15:02:33 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=384798 00:01:29.287 15:02:33 -- pm/common@21 -- $ date +%s 00:01:29.287 15:02:33 -- pm/common@26 -- $ sleep 1 00:01:29.287 15:02:33 -- pm/common@21 -- $ date +%s 00:01:29.287 15:02:33 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713963753 00:01:29.287 15:02:33 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713963753 00:01:29.288 15:02:33 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713963753 00:01:29.288 15:02:33 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1713963753 00:01:29.288 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713963753_collect-cpu-load.pm.log 00:01:29.288 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713963753_collect-vmstat.pm.log 00:01:29.288 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713963753_collect-bmc-pm.bmc.pm.log 00:01:29.288 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1713963753_collect-cpu-temp.pm.log 00:01:30.227 15:02:34 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:01:30.227 15:02:34 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:30.227 15:02:34 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:30.227 15:02:34 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:01:30.227 15:02:34 -- spdk/autobuild.sh@16 -- $ date -u 00:01:30.227 Wed Apr 24 01:02:34 PM UTC 2024 00:01:30.227 15:02:34 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:30.227 v24.05-pre-437-g3f2c89791 00:01:30.227 15:02:34 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:30.227 15:02:34 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:30.227 15:02:34 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:30.227 15:02:34 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:30.227 15:02:34 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:30.227 15:02:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.487 ************************************ 00:01:30.487 START TEST ubsan 00:01:30.487 ************************************ 00:01:30.487 15:02:34 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:01:30.487 using ubsan 00:01:30.487 00:01:30.487 real 0m0.001s 00:01:30.487 user 0m0.000s 00:01:30.487 sys 0m0.000s 00:01:30.487 15:02:34 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:30.487 15:02:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.487 ************************************ 00:01:30.487 END TEST ubsan 00:01:30.487 ************************************ 00:01:30.487 15:02:34 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:30.487 15:02:34 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:30.487 15:02:34 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:30.487 15:02:34 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:30.487 Using default SPDK env in /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:01:30.487 Using default DPDK in /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:01:30.747 Using 'verbs' RDMA provider 00:01:43.921 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:58.820 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:58.820 Creating mk/config.mk...done. 00:01:58.820 Creating mk/cc.flags.mk...done. 00:01:58.820 Type 'make' to build. 00:01:58.820 15:03:01 -- spdk/autobuild.sh@69 -- $ run_test make make -j72 00:01:58.820 15:03:01 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:58.820 15:03:01 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:58.820 15:03:01 -- common/autotest_common.sh@10 -- $ set +x 00:01:58.820 ************************************ 00:01:58.820 START TEST make 00:01:58.820 ************************************ 00:01:58.820 15:03:01 -- common/autotest_common.sh@1111 -- $ make -j72 00:01:58.820 make[1]: Nothing to be done for 'all'. 00:02:07.136 The Meson build system 00:02:07.136 Version: 1.3.1 00:02:07.136 Source dir: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk 00:02:07.136 Build dir: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp 00:02:07.136 Build type: native build 00:02:07.136 Program cat found: YES (/usr/bin/cat) 00:02:07.136 Project name: DPDK 00:02:07.136 Project version: 23.11.0 00:02:07.136 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:02:07.136 C linker for the host machine: cc ld.bfd 2.39-16 00:02:07.136 Host machine cpu family: x86_64 00:02:07.136 Host machine cpu: x86_64 00:02:07.136 Message: ## Building in Developer Mode ## 00:02:07.136 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:07.136 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:02:07.136 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:07.136 Program python3 found: YES (/usr/bin/python3) 00:02:07.136 Program cat found: YES (/usr/bin/cat) 00:02:07.136 Compiler for C supports arguments -march=native: YES 00:02:07.136 Checking for size of "void *" : 8 00:02:07.136 Checking for size of "void *" : 8 (cached) 00:02:07.136 Library m found: YES 00:02:07.136 Library numa found: YES 00:02:07.136 Has header "numaif.h" : YES 00:02:07.136 Library fdt found: NO 00:02:07.136 Library execinfo found: NO 00:02:07.136 Has header "execinfo.h" : YES 00:02:07.136 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:02:07.136 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:07.136 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:07.136 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:07.136 Run-time dependency openssl found: YES 3.0.9 00:02:07.136 Run-time dependency libpcap found: YES 1.10.4 00:02:07.136 Has header "pcap.h" with dependency libpcap: YES 00:02:07.136 Compiler for C supports arguments -Wcast-qual: YES 00:02:07.136 Compiler for C supports arguments -Wdeprecated: YES 00:02:07.136 Compiler for C supports arguments -Wformat: YES 00:02:07.136 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:07.136 Compiler for C supports arguments -Wformat-security: NO 00:02:07.136 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:07.136 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:07.136 Compiler for C supports arguments -Wnested-externs: YES 00:02:07.136 Compiler for C supports arguments -Wold-style-definition: YES 00:02:07.136 Compiler for C supports arguments -Wpointer-arith: YES 00:02:07.136 Compiler for C supports arguments -Wsign-compare: YES 00:02:07.136 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:07.136 Compiler for C supports arguments -Wundef: YES 00:02:07.136 Compiler for C supports arguments -Wwrite-strings: YES 00:02:07.136 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:07.136 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:07.136 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:07.136 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:07.136 Program objdump found: YES (/usr/bin/objdump) 00:02:07.136 Compiler for C supports arguments -mavx512f: YES 00:02:07.136 Checking if "AVX512 checking" compiles: YES 00:02:07.136 Fetching value of define "__SSE4_2__" : 1 00:02:07.136 Fetching value of define "__AES__" : 1 00:02:07.136 Fetching value of define "__AVX__" : 1 00:02:07.136 Fetching value of define "__AVX2__" : 1 00:02:07.136 Fetching value of define "__AVX512BW__" : 1 00:02:07.136 Fetching value of define "__AVX512CD__" : 1 00:02:07.136 Fetching value of define "__AVX512DQ__" : 1 00:02:07.136 Fetching value of define "__AVX512F__" : 1 00:02:07.136 Fetching value of define "__AVX512VL__" : 1 00:02:07.136 Fetching value of define "__PCLMUL__" : 1 00:02:07.136 Fetching value of define "__RDRND__" : 1 00:02:07.136 Fetching value of define "__RDSEED__" : 1 00:02:07.136 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:07.136 Fetching value of define "__znver1__" : (undefined) 00:02:07.136 Fetching value of define "__znver2__" : (undefined) 00:02:07.136 Fetching value of define "__znver3__" : (undefined) 00:02:07.136 Fetching value of define "__znver4__" : (undefined) 00:02:07.136 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:07.136 Message: lib/log: Defining dependency "log" 00:02:07.136 Message: lib/kvargs: Defining dependency "kvargs" 00:02:07.136 Message: lib/telemetry: Defining dependency "telemetry" 00:02:07.136 Checking for function "getentropy" : NO 00:02:07.136 Message: lib/eal: Defining dependency "eal" 00:02:07.136 Message: lib/ring: Defining dependency "ring" 00:02:07.136 Message: lib/rcu: Defining dependency "rcu" 00:02:07.136 Message: lib/mempool: Defining dependency "mempool" 00:02:07.136 Message: lib/mbuf: Defining dependency "mbuf" 00:02:07.136 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:07.136 Fetching value of define "__AVX512F__" : 1 (cached) 00:02:07.136 Fetching value of define "__AVX512BW__" : 1 (cached) 00:02:07.136 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:02:07.136 Fetching value of define "__AVX512VL__" : 1 (cached) 00:02:07.136 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:02:07.136 Compiler for C supports arguments -mpclmul: YES 00:02:07.136 Compiler for C supports arguments -maes: YES 00:02:07.136 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:07.136 Compiler for C supports arguments -mavx512bw: YES 00:02:07.136 Compiler for C supports arguments -mavx512dq: YES 00:02:07.136 Compiler for C supports arguments -mavx512vl: YES 00:02:07.136 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:07.136 Compiler for C supports arguments -mavx2: YES 00:02:07.136 Compiler for C supports arguments -mavx: YES 00:02:07.136 Message: lib/net: Defining dependency "net" 00:02:07.136 Message: lib/meter: Defining dependency "meter" 00:02:07.136 Message: lib/ethdev: Defining dependency "ethdev" 00:02:07.136 Message: lib/pci: Defining dependency "pci" 00:02:07.136 Message: lib/cmdline: Defining dependency "cmdline" 00:02:07.136 Message: lib/hash: Defining dependency "hash" 00:02:07.136 Message: lib/timer: Defining dependency "timer" 00:02:07.136 Message: lib/compressdev: Defining dependency "compressdev" 00:02:07.136 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:07.136 Message: lib/dmadev: Defining dependency "dmadev" 00:02:07.136 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:07.136 Message: lib/power: Defining dependency "power" 00:02:07.136 Message: lib/reorder: Defining dependency "reorder" 00:02:07.136 Message: lib/security: Defining dependency "security" 00:02:07.136 Has header "linux/userfaultfd.h" : YES 00:02:07.136 Has header "linux/vduse.h" : YES 00:02:07.136 Message: lib/vhost: Defining dependency "vhost" 00:02:07.136 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:07.136 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:07.136 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:07.136 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:07.136 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:07.136 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:07.136 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:07.136 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:07.136 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:07.136 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:07.136 Program doxygen found: YES (/usr/bin/doxygen) 00:02:07.136 Configuring doxy-api-html.conf using configuration 00:02:07.136 Configuring doxy-api-man.conf using configuration 00:02:07.136 Program mandb found: YES (/usr/bin/mandb) 00:02:07.136 Program sphinx-build found: NO 00:02:07.136 Configuring rte_build_config.h using configuration 00:02:07.136 Message: 00:02:07.136 ================= 00:02:07.136 Applications Enabled 00:02:07.136 ================= 00:02:07.136 00:02:07.136 apps: 00:02:07.136 00:02:07.136 00:02:07.136 Message: 00:02:07.136 ================= 00:02:07.136 Libraries Enabled 00:02:07.136 ================= 00:02:07.136 00:02:07.136 libs: 00:02:07.136 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:07.136 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:07.136 cryptodev, dmadev, power, reorder, security, vhost, 00:02:07.136 00:02:07.136 Message: 00:02:07.136 =============== 00:02:07.136 Drivers Enabled 00:02:07.136 =============== 00:02:07.136 00:02:07.136 common: 00:02:07.136 00:02:07.136 bus: 00:02:07.136 pci, vdev, 00:02:07.136 mempool: 00:02:07.136 ring, 00:02:07.136 dma: 00:02:07.136 00:02:07.136 net: 00:02:07.136 00:02:07.136 crypto: 00:02:07.136 00:02:07.136 compress: 00:02:07.136 00:02:07.136 vdpa: 00:02:07.136 00:02:07.136 00:02:07.136 Message: 00:02:07.136 ================= 00:02:07.136 Content Skipped 00:02:07.136 ================= 00:02:07.136 00:02:07.136 apps: 00:02:07.137 dumpcap: explicitly disabled via build config 00:02:07.137 graph: explicitly disabled via build config 00:02:07.137 pdump: explicitly disabled via build config 00:02:07.137 proc-info: explicitly disabled via build config 00:02:07.137 test-acl: explicitly disabled via build config 00:02:07.137 test-bbdev: explicitly disabled via build config 00:02:07.137 test-cmdline: explicitly disabled via build config 00:02:07.137 test-compress-perf: explicitly disabled via build config 00:02:07.137 test-crypto-perf: explicitly disabled via build config 00:02:07.137 test-dma-perf: explicitly disabled via build config 00:02:07.137 test-eventdev: explicitly disabled via build config 00:02:07.137 test-fib: explicitly disabled via build config 00:02:07.137 test-flow-perf: explicitly disabled via build config 00:02:07.137 test-gpudev: explicitly disabled via build config 00:02:07.137 test-mldev: explicitly disabled via build config 00:02:07.137 test-pipeline: explicitly disabled via build config 00:02:07.137 test-pmd: explicitly disabled via build config 00:02:07.137 test-regex: explicitly disabled via build config 00:02:07.137 test-sad: explicitly disabled via build config 00:02:07.137 test-security-perf: explicitly disabled via build config 00:02:07.137 00:02:07.137 libs: 00:02:07.137 metrics: explicitly disabled via build config 00:02:07.137 acl: explicitly disabled via build config 00:02:07.137 bbdev: explicitly disabled via build config 00:02:07.137 bitratestats: explicitly disabled via build config 00:02:07.137 bpf: explicitly disabled via build config 00:02:07.137 cfgfile: explicitly disabled via build config 00:02:07.137 distributor: explicitly disabled via build config 00:02:07.137 efd: explicitly disabled via build config 00:02:07.137 eventdev: explicitly disabled via build config 00:02:07.137 dispatcher: explicitly disabled via build config 00:02:07.137 gpudev: explicitly disabled via build config 00:02:07.137 gro: explicitly disabled via build config 00:02:07.137 gso: explicitly disabled via build config 00:02:07.137 ip_frag: explicitly disabled via build config 00:02:07.137 jobstats: explicitly disabled via build config 00:02:07.137 latencystats: explicitly disabled via build config 00:02:07.137 lpm: explicitly disabled via build config 00:02:07.137 member: explicitly disabled via build config 00:02:07.137 pcapng: explicitly disabled via build config 00:02:07.137 rawdev: explicitly disabled via build config 00:02:07.137 regexdev: explicitly disabled via build config 00:02:07.137 mldev: explicitly disabled via build config 00:02:07.137 rib: explicitly disabled via build config 00:02:07.137 sched: explicitly disabled via build config 00:02:07.137 stack: explicitly disabled via build config 00:02:07.137 ipsec: explicitly disabled via build config 00:02:07.137 pdcp: explicitly disabled via build config 00:02:07.137 fib: explicitly disabled via build config 00:02:07.137 port: explicitly disabled via build config 00:02:07.137 pdump: explicitly disabled via build config 00:02:07.137 table: explicitly disabled via build config 00:02:07.137 pipeline: explicitly disabled via build config 00:02:07.137 graph: explicitly disabled via build config 00:02:07.137 node: explicitly disabled via build config 00:02:07.137 00:02:07.137 drivers: 00:02:07.137 common/cpt: not in enabled drivers build config 00:02:07.137 common/dpaax: not in enabled drivers build config 00:02:07.137 common/iavf: not in enabled drivers build config 00:02:07.137 common/idpf: not in enabled drivers build config 00:02:07.137 common/mvep: not in enabled drivers build config 00:02:07.137 common/octeontx: not in enabled drivers build config 00:02:07.137 bus/auxiliary: not in enabled drivers build config 00:02:07.137 bus/cdx: not in enabled drivers build config 00:02:07.137 bus/dpaa: not in enabled drivers build config 00:02:07.137 bus/fslmc: not in enabled drivers build config 00:02:07.137 bus/ifpga: not in enabled drivers build config 00:02:07.137 bus/platform: not in enabled drivers build config 00:02:07.137 bus/vmbus: not in enabled drivers build config 00:02:07.137 common/cnxk: not in enabled drivers build config 00:02:07.137 common/mlx5: not in enabled drivers build config 00:02:07.137 common/nfp: not in enabled drivers build config 00:02:07.137 common/qat: not in enabled drivers build config 00:02:07.137 common/sfc_efx: not in enabled drivers build config 00:02:07.137 mempool/bucket: not in enabled drivers build config 00:02:07.137 mempool/cnxk: not in enabled drivers build config 00:02:07.137 mempool/dpaa: not in enabled drivers build config 00:02:07.137 mempool/dpaa2: not in enabled drivers build config 00:02:07.137 mempool/octeontx: not in enabled drivers build config 00:02:07.137 mempool/stack: not in enabled drivers build config 00:02:07.137 dma/cnxk: not in enabled drivers build config 00:02:07.137 dma/dpaa: not in enabled drivers build config 00:02:07.137 dma/dpaa2: not in enabled drivers build config 00:02:07.137 dma/hisilicon: not in enabled drivers build config 00:02:07.137 dma/idxd: not in enabled drivers build config 00:02:07.137 dma/ioat: not in enabled drivers build config 00:02:07.137 dma/skeleton: not in enabled drivers build config 00:02:07.137 net/af_packet: not in enabled drivers build config 00:02:07.137 net/af_xdp: not in enabled drivers build config 00:02:07.137 net/ark: not in enabled drivers build config 00:02:07.137 net/atlantic: not in enabled drivers build config 00:02:07.137 net/avp: not in enabled drivers build config 00:02:07.137 net/axgbe: not in enabled drivers build config 00:02:07.137 net/bnx2x: not in enabled drivers build config 00:02:07.137 net/bnxt: not in enabled drivers build config 00:02:07.137 net/bonding: not in enabled drivers build config 00:02:07.137 net/cnxk: not in enabled drivers build config 00:02:07.137 net/cpfl: not in enabled drivers build config 00:02:07.137 net/cxgbe: not in enabled drivers build config 00:02:07.137 net/dpaa: not in enabled drivers build config 00:02:07.137 net/dpaa2: not in enabled drivers build config 00:02:07.137 net/e1000: not in enabled drivers build config 00:02:07.137 net/ena: not in enabled drivers build config 00:02:07.137 net/enetc: not in enabled drivers build config 00:02:07.137 net/enetfec: not in enabled drivers build config 00:02:07.137 net/enic: not in enabled drivers build config 00:02:07.137 net/failsafe: not in enabled drivers build config 00:02:07.137 net/fm10k: not in enabled drivers build config 00:02:07.137 net/gve: not in enabled drivers build config 00:02:07.137 net/hinic: not in enabled drivers build config 00:02:07.137 net/hns3: not in enabled drivers build config 00:02:07.137 net/i40e: not in enabled drivers build config 00:02:07.137 net/iavf: not in enabled drivers build config 00:02:07.137 net/ice: not in enabled drivers build config 00:02:07.137 net/idpf: not in enabled drivers build config 00:02:07.137 net/igc: not in enabled drivers build config 00:02:07.137 net/ionic: not in enabled drivers build config 00:02:07.137 net/ipn3ke: not in enabled drivers build config 00:02:07.137 net/ixgbe: not in enabled drivers build config 00:02:07.137 net/mana: not in enabled drivers build config 00:02:07.137 net/memif: not in enabled drivers build config 00:02:07.137 net/mlx4: not in enabled drivers build config 00:02:07.137 net/mlx5: not in enabled drivers build config 00:02:07.137 net/mvneta: not in enabled drivers build config 00:02:07.137 net/mvpp2: not in enabled drivers build config 00:02:07.137 net/netvsc: not in enabled drivers build config 00:02:07.137 net/nfb: not in enabled drivers build config 00:02:07.137 net/nfp: not in enabled drivers build config 00:02:07.137 net/ngbe: not in enabled drivers build config 00:02:07.137 net/null: not in enabled drivers build config 00:02:07.137 net/octeontx: not in enabled drivers build config 00:02:07.137 net/octeon_ep: not in enabled drivers build config 00:02:07.137 net/pcap: not in enabled drivers build config 00:02:07.137 net/pfe: not in enabled drivers build config 00:02:07.137 net/qede: not in enabled drivers build config 00:02:07.137 net/ring: not in enabled drivers build config 00:02:07.137 net/sfc: not in enabled drivers build config 00:02:07.137 net/softnic: not in enabled drivers build config 00:02:07.137 net/tap: not in enabled drivers build config 00:02:07.137 net/thunderx: not in enabled drivers build config 00:02:07.137 net/txgbe: not in enabled drivers build config 00:02:07.137 net/vdev_netvsc: not in enabled drivers build config 00:02:07.137 net/vhost: not in enabled drivers build config 00:02:07.137 net/virtio: not in enabled drivers build config 00:02:07.137 net/vmxnet3: not in enabled drivers build config 00:02:07.137 raw/*: missing internal dependency, "rawdev" 00:02:07.137 crypto/armv8: not in enabled drivers build config 00:02:07.137 crypto/bcmfs: not in enabled drivers build config 00:02:07.137 crypto/caam_jr: not in enabled drivers build config 00:02:07.137 crypto/ccp: not in enabled drivers build config 00:02:07.137 crypto/cnxk: not in enabled drivers build config 00:02:07.137 crypto/dpaa_sec: not in enabled drivers build config 00:02:07.137 crypto/dpaa2_sec: not in enabled drivers build config 00:02:07.137 crypto/ipsec_mb: not in enabled drivers build config 00:02:07.137 crypto/mlx5: not in enabled drivers build config 00:02:07.137 crypto/mvsam: not in enabled drivers build config 00:02:07.137 crypto/nitrox: not in enabled drivers build config 00:02:07.137 crypto/null: not in enabled drivers build config 00:02:07.137 crypto/octeontx: not in enabled drivers build config 00:02:07.137 crypto/openssl: not in enabled drivers build config 00:02:07.137 crypto/scheduler: not in enabled drivers build config 00:02:07.137 crypto/uadk: not in enabled drivers build config 00:02:07.137 crypto/virtio: not in enabled drivers build config 00:02:07.137 compress/isal: not in enabled drivers build config 00:02:07.137 compress/mlx5: not in enabled drivers build config 00:02:07.137 compress/octeontx: not in enabled drivers build config 00:02:07.137 compress/zlib: not in enabled drivers build config 00:02:07.137 regex/*: missing internal dependency, "regexdev" 00:02:07.137 ml/*: missing internal dependency, "mldev" 00:02:07.137 vdpa/ifc: not in enabled drivers build config 00:02:07.137 vdpa/mlx5: not in enabled drivers build config 00:02:07.137 vdpa/nfp: not in enabled drivers build config 00:02:07.137 vdpa/sfc: not in enabled drivers build config 00:02:07.137 event/*: missing internal dependency, "eventdev" 00:02:07.137 baseband/*: missing internal dependency, "bbdev" 00:02:07.137 gpu/*: missing internal dependency, "gpudev" 00:02:07.137 00:02:07.137 00:02:07.137 Build targets in project: 85 00:02:07.137 00:02:07.137 DPDK 23.11.0 00:02:07.137 00:02:07.137 User defined options 00:02:07.137 buildtype : debug 00:02:07.137 default_library : shared 00:02:07.137 libdir : lib 00:02:07.138 prefix : /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:02:07.138 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:02:07.138 c_link_args : 00:02:07.138 cpu_instruction_set: native 00:02:07.138 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:02:07.138 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:02:07.138 enable_docs : false 00:02:07.138 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:07.138 enable_kmods : false 00:02:07.138 tests : false 00:02:07.138 00:02:07.138 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:07.401 ninja: Entering directory `/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp' 00:02:07.401 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:07.401 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:07.401 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:07.401 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:07.401 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:07.401 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:07.401 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:07.401 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:07.401 [9/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:07.401 [10/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:07.401 [11/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:07.401 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:07.401 [13/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:07.401 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:07.401 [15/265] Linking static target lib/librte_kvargs.a 00:02:07.401 [16/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:07.401 [17/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:07.401 [18/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:07.401 [19/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:07.401 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:07.401 [21/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:07.401 [22/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:07.401 [23/265] Linking static target lib/librte_log.a 00:02:07.401 [24/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:07.401 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:07.982 [26/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:07.982 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:07.982 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:07.982 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:07.982 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:07.982 [31/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:07.982 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:07.982 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:07.982 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:07.982 [35/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:07.982 [36/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:07.982 [37/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:07.982 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:07.982 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:07.982 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:07.982 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:07.982 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:07.982 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:07.982 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:07.982 [45/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:07.982 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:07.982 [47/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:07.982 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:07.982 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:07.982 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:07.982 [51/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:07.982 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:07.982 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:07.982 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:07.982 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:07.982 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:07.982 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:07.982 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:07.982 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:07.982 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:07.982 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:07.982 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:07.982 [63/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:07.982 [64/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:07.982 [65/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:07.982 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:07.982 [67/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:07.982 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:07.982 [69/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:07.982 [70/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:07.982 [71/265] Linking static target lib/librte_ring.a 00:02:07.982 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:07.982 [73/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:07.982 [74/265] Linking static target lib/librte_telemetry.a 00:02:07.982 [75/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:07.982 [76/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:07.982 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:07.982 [78/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:07.982 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:07.982 [80/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:07.982 [81/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:07.982 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:07.982 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:07.982 [84/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:07.982 [85/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:07.982 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:07.982 [87/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:07.982 [88/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:07.982 [89/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:07.982 [90/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:07.982 [91/265] Linking static target lib/librte_pci.a 00:02:07.982 [92/265] Linking static target lib/librte_meter.a 00:02:07.982 [93/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:07.982 [94/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:07.982 [95/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:07.982 [96/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:07.982 [97/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:07.982 [98/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:07.982 [99/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:07.982 [100/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:07.982 [101/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:07.982 [102/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:07.982 [103/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:08.242 [104/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:08.242 [105/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:08.242 [106/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:08.242 [107/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:08.242 [108/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:08.242 [109/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:08.242 [110/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:08.242 [111/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:08.242 [112/265] Linking static target lib/librte_rcu.a 00:02:08.242 [113/265] Linking static target lib/librte_mempool.a 00:02:08.242 [114/265] Linking static target lib/librte_net.a 00:02:08.242 [115/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:08.242 [116/265] Linking static target lib/librte_eal.a 00:02:08.242 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:08.242 [118/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:08.242 [119/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:08.242 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:08.243 [121/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [122/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [123/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [124/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [125/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:08.502 [126/265] Linking static target lib/librte_mbuf.a 00:02:08.502 [127/265] Linking target lib/librte_log.so.24.0 00:02:08.502 [128/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:08.502 [129/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:08.502 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:08.502 [131/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:08.502 [133/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:08.502 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:08.502 [135/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [136/265] Linking static target lib/librte_cmdline.a 00:02:08.502 [137/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:08.502 [138/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:08.502 [139/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:08.502 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:08.502 [141/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:08.502 [142/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:08.502 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:08.502 [144/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:08.502 [145/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:08.502 [146/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:08.502 [147/265] Linking static target lib/librte_timer.a 00:02:08.502 [148/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:08.502 [149/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:08.502 [150/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:08.502 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:08.502 [152/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:08.502 [153/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:08.502 [154/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:08.502 [155/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:08.502 [156/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:08.502 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:08.502 [158/265] Linking static target lib/librte_power.a 00:02:08.502 [159/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:08.502 [160/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:08.502 [161/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:08.502 [162/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:08.502 [163/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:08.502 [164/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:08.502 [165/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:08.502 [166/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:08.502 [167/265] Linking static target lib/librte_compressdev.a 00:02:08.502 [168/265] Linking static target lib/librte_dmadev.a 00:02:08.502 [169/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:08.762 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:08.762 [171/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:08.762 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:08.762 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:08.762 [174/265] Linking target lib/librte_telemetry.so.24.0 00:02:08.762 [175/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:08.762 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:08.762 [177/265] Linking target lib/librte_kvargs.so.24.0 00:02:08.762 [178/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:08.762 [179/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:08.762 [180/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:08.762 [181/265] Linking static target lib/librte_reorder.a 00:02:08.762 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:08.762 [183/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:08.762 [184/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:08.762 [185/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:08.762 [186/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:08.762 [187/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:08.762 [188/265] Linking static target lib/librte_security.a 00:02:08.762 [189/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:08.762 [190/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:08.762 [191/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:08.762 [192/265] Linking static target lib/librte_hash.a 00:02:08.762 [193/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:08.762 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:08.762 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:08.762 [196/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:08.762 [197/265] Linking static target drivers/librte_bus_vdev.a 00:02:08.762 [198/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:09.022 [199/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.022 [200/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:09.022 [201/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:09.022 [202/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.022 [203/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:09.022 [204/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:09.022 [205/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:09.022 [206/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:09.022 [207/265] Linking static target drivers/librte_mempool_ring.a 00:02:09.022 [208/265] Linking static target drivers/librte_bus_pci.a 00:02:09.022 [209/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:09.022 [210/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:09.022 [211/265] Linking static target lib/librte_cryptodev.a 00:02:09.022 [212/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.022 [213/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.022 [214/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.281 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.281 [216/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.281 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.281 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:09.540 [219/265] Linking static target lib/librte_ethdev.a 00:02:09.540 [220/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:09.540 [221/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.540 [222/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.800 [223/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.800 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:10.368 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:10.368 [226/265] Linking static target lib/librte_vhost.a 00:02:11.312 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:12.692 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:18.024 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:20.562 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:20.562 [231/265] Linking target lib/librte_eal.so.24.0 00:02:20.821 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:20.821 [233/265] Linking target lib/librte_pci.so.24.0 00:02:20.821 [234/265] Linking target lib/librte_dmadev.so.24.0 00:02:20.821 [235/265] Linking target lib/librte_meter.so.24.0 00:02:20.821 [236/265] Linking target lib/librte_timer.so.24.0 00:02:20.821 [237/265] Linking target lib/librte_ring.so.24.0 00:02:20.821 [238/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:20.821 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:20.821 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:21.081 [241/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:21.081 [242/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:21.081 [243/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:21.081 [244/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:21.081 [245/265] Linking target lib/librte_rcu.so.24.0 00:02:21.081 [246/265] Linking target lib/librte_mempool.so.24.0 00:02:21.081 [247/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:21.081 [248/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:21.340 [249/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:21.340 [250/265] Linking target lib/librte_mbuf.so.24.0 00:02:21.340 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:21.340 [252/265] Linking target lib/librte_compressdev.so.24.0 00:02:21.340 [253/265] Linking target lib/librte_net.so.24.0 00:02:21.340 [254/265] Linking target lib/librte_reorder.so.24.0 00:02:21.340 [255/265] Linking target lib/librte_cryptodev.so.24.0 00:02:21.599 [256/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:21.599 [257/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:21.599 [258/265] Linking target lib/librte_cmdline.so.24.0 00:02:21.599 [259/265] Linking target lib/librte_hash.so.24.0 00:02:21.599 [260/265] Linking target lib/librte_security.so.24.0 00:02:21.599 [261/265] Linking target lib/librte_ethdev.so.24.0 00:02:21.859 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:21.859 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:21.859 [264/265] Linking target lib/librte_power.so.24.0 00:02:21.859 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:21.859 INFO: autodetecting backend as ninja 00:02:21.859 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build-tmp -j 72 00:02:22.797 CC lib/ut/ut.o 00:02:23.056 CC lib/ut_mock/mock.o 00:02:23.056 CC lib/log/log.o 00:02:23.056 CC lib/log/log_deprecated.o 00:02:23.056 CC lib/log/log_flags.o 00:02:23.056 LIB libspdk_ut.a 00:02:23.056 SO libspdk_ut.so.2.0 00:02:23.056 LIB libspdk_ut_mock.a 00:02:23.056 SO libspdk_ut_mock.so.6.0 00:02:23.056 LIB libspdk_log.a 00:02:23.056 SYMLINK libspdk_ut.so 00:02:23.056 SO libspdk_log.so.7.0 00:02:23.314 SYMLINK libspdk_ut_mock.so 00:02:23.314 SYMLINK libspdk_log.so 00:02:23.574 CC lib/util/bit_array.o 00:02:23.574 CC lib/util/base64.o 00:02:23.574 CC lib/util/crc16.o 00:02:23.574 CC lib/util/cpuset.o 00:02:23.574 CC lib/util/crc32.o 00:02:23.574 CC lib/util/crc32c.o 00:02:23.574 CC lib/util/crc32_ieee.o 00:02:23.574 CC lib/util/dif.o 00:02:23.574 CC lib/util/crc64.o 00:02:23.574 CC lib/util/file.o 00:02:23.574 CC lib/util/fd.o 00:02:23.574 CC lib/util/math.o 00:02:23.574 CC lib/util/hexlify.o 00:02:23.574 CC lib/util/pipe.o 00:02:23.574 CC lib/util/iov.o 00:02:23.574 CC lib/util/uuid.o 00:02:23.574 CXX lib/trace_parser/trace.o 00:02:23.574 CC lib/util/strerror_tls.o 00:02:23.574 CC lib/dma/dma.o 00:02:23.574 CC lib/util/fd_group.o 00:02:23.574 CC lib/util/string.o 00:02:23.574 CC lib/util/xor.o 00:02:23.574 CC lib/util/zipf.o 00:02:23.574 CC lib/ioat/ioat.o 00:02:23.833 CC lib/vfio_user/host/vfio_user_pci.o 00:02:23.833 CC lib/vfio_user/host/vfio_user.o 00:02:23.833 LIB libspdk_dma.a 00:02:23.833 SO libspdk_dma.so.4.0 00:02:23.833 LIB libspdk_ioat.a 00:02:23.833 SYMLINK libspdk_dma.so 00:02:23.833 SO libspdk_ioat.so.7.0 00:02:23.833 SYMLINK libspdk_ioat.so 00:02:24.092 LIB libspdk_vfio_user.a 00:02:24.092 SO libspdk_vfio_user.so.5.0 00:02:24.092 LIB libspdk_util.a 00:02:24.092 SYMLINK libspdk_vfio_user.so 00:02:24.092 SO libspdk_util.so.9.0 00:02:24.352 SYMLINK libspdk_util.so 00:02:24.352 LIB libspdk_trace_parser.a 00:02:24.352 SO libspdk_trace_parser.so.5.0 00:02:24.352 SYMLINK libspdk_trace_parser.so 00:02:24.611 CC lib/json/json_parse.o 00:02:24.611 CC lib/json/json_util.o 00:02:24.611 CC lib/idxd/idxd_user.o 00:02:24.611 CC lib/json/json_write.o 00:02:24.611 CC lib/idxd/idxd.o 00:02:24.611 CC lib/conf/conf.o 00:02:24.611 CC lib/rdma/common.o 00:02:24.611 CC lib/vmd/vmd.o 00:02:24.611 CC lib/rdma/rdma_verbs.o 00:02:24.611 CC lib/vmd/led.o 00:02:24.611 CC lib/env_dpdk/env.o 00:02:24.611 CC lib/env_dpdk/memory.o 00:02:24.611 CC lib/env_dpdk/pci_ioat.o 00:02:24.611 CC lib/env_dpdk/pci.o 00:02:24.611 CC lib/env_dpdk/init.o 00:02:24.611 CC lib/env_dpdk/threads.o 00:02:24.611 CC lib/env_dpdk/pci_virtio.o 00:02:24.611 CC lib/env_dpdk/pci_vmd.o 00:02:24.611 CC lib/env_dpdk/pci_event.o 00:02:24.611 CC lib/env_dpdk/pci_idxd.o 00:02:24.611 CC lib/env_dpdk/sigbus_handler.o 00:02:24.611 CC lib/env_dpdk/pci_dpdk.o 00:02:24.611 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:24.611 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:24.870 LIB libspdk_conf.a 00:02:24.870 SO libspdk_conf.so.6.0 00:02:24.870 LIB libspdk_json.a 00:02:24.870 SYMLINK libspdk_conf.so 00:02:24.870 LIB libspdk_rdma.a 00:02:24.870 SO libspdk_json.so.6.0 00:02:24.870 SO libspdk_rdma.so.6.0 00:02:24.870 SYMLINK libspdk_json.so 00:02:24.870 SYMLINK libspdk_rdma.so 00:02:25.128 LIB libspdk_idxd.a 00:02:25.128 SO libspdk_idxd.so.12.0 00:02:25.128 LIB libspdk_vmd.a 00:02:25.128 SYMLINK libspdk_idxd.so 00:02:25.128 SO libspdk_vmd.so.6.0 00:02:25.128 SYMLINK libspdk_vmd.so 00:02:25.128 CC lib/jsonrpc/jsonrpc_server.o 00:02:25.128 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:25.128 CC lib/jsonrpc/jsonrpc_client.o 00:02:25.128 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:25.388 LIB libspdk_jsonrpc.a 00:02:25.648 SO libspdk_jsonrpc.so.6.0 00:02:25.648 SYMLINK libspdk_jsonrpc.so 00:02:25.648 LIB libspdk_env_dpdk.a 00:02:25.648 SO libspdk_env_dpdk.so.14.0 00:02:25.907 SYMLINK libspdk_env_dpdk.so 00:02:25.907 CC lib/rpc/rpc.o 00:02:26.166 LIB libspdk_rpc.a 00:02:26.166 SO libspdk_rpc.so.6.0 00:02:26.166 SYMLINK libspdk_rpc.so 00:02:26.734 CC lib/keyring/keyring_rpc.o 00:02:26.734 CC lib/keyring/keyring.o 00:02:26.734 CC lib/trace/trace.o 00:02:26.734 CC lib/trace/trace_flags.o 00:02:26.734 CC lib/trace/trace_rpc.o 00:02:26.734 CC lib/notify/notify.o 00:02:26.734 CC lib/notify/notify_rpc.o 00:02:26.734 LIB libspdk_notify.a 00:02:26.734 LIB libspdk_keyring.a 00:02:26.734 SO libspdk_notify.so.6.0 00:02:26.734 LIB libspdk_trace.a 00:02:26.734 SO libspdk_keyring.so.1.0 00:02:26.993 SO libspdk_trace.so.10.0 00:02:26.994 SYMLINK libspdk_notify.so 00:02:26.994 SYMLINK libspdk_keyring.so 00:02:26.994 SYMLINK libspdk_trace.so 00:02:27.253 CC lib/thread/thread.o 00:02:27.253 CC lib/thread/iobuf.o 00:02:27.253 CC lib/sock/sock.o 00:02:27.253 CC lib/sock/sock_rpc.o 00:02:27.512 LIB libspdk_sock.a 00:02:27.771 SO libspdk_sock.so.9.0 00:02:27.771 SYMLINK libspdk_sock.so 00:02:28.030 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:28.030 CC lib/nvme/nvme_fabric.o 00:02:28.030 CC lib/nvme/nvme_ctrlr.o 00:02:28.030 CC lib/nvme/nvme_ns.o 00:02:28.030 CC lib/nvme/nvme_ns_cmd.o 00:02:28.030 CC lib/nvme/nvme_qpair.o 00:02:28.030 CC lib/nvme/nvme_pcie_common.o 00:02:28.030 CC lib/nvme/nvme_pcie.o 00:02:28.030 CC lib/nvme/nvme.o 00:02:28.030 CC lib/nvme/nvme_quirks.o 00:02:28.030 CC lib/nvme/nvme_transport.o 00:02:28.030 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:28.030 CC lib/nvme/nvme_discovery.o 00:02:28.030 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:28.030 CC lib/nvme/nvme_tcp.o 00:02:28.030 CC lib/nvme/nvme_opal.o 00:02:28.030 CC lib/nvme/nvme_io_msg.o 00:02:28.030 CC lib/nvme/nvme_poll_group.o 00:02:28.030 CC lib/nvme/nvme_zns.o 00:02:28.030 CC lib/nvme/nvme_stubs.o 00:02:28.030 CC lib/nvme/nvme_auth.o 00:02:28.030 CC lib/nvme/nvme_cuse.o 00:02:28.030 CC lib/nvme/nvme_rdma.o 00:02:28.290 LIB libspdk_thread.a 00:02:28.290 SO libspdk_thread.so.10.0 00:02:28.290 SYMLINK libspdk_thread.so 00:02:28.859 CC lib/accel/accel.o 00:02:28.859 CC lib/accel/accel_sw.o 00:02:28.859 CC lib/accel/accel_rpc.o 00:02:28.859 CC lib/blob/blobstore.o 00:02:28.859 CC lib/blob/request.o 00:02:28.859 CC lib/blob/blob_bs_dev.o 00:02:28.859 CC lib/blob/zeroes.o 00:02:28.859 CC lib/virtio/virtio_vhost_user.o 00:02:28.859 CC lib/virtio/virtio.o 00:02:28.859 CC lib/virtio/virtio_vfio_user.o 00:02:28.859 CC lib/virtio/virtio_pci.o 00:02:28.859 CC lib/init/json_config.o 00:02:28.859 CC lib/init/subsystem.o 00:02:28.859 CC lib/init/subsystem_rpc.o 00:02:28.859 CC lib/init/rpc.o 00:02:28.859 LIB libspdk_init.a 00:02:29.117 LIB libspdk_virtio.a 00:02:29.117 SO libspdk_init.so.5.0 00:02:29.117 SO libspdk_virtio.so.7.0 00:02:29.117 SYMLINK libspdk_init.so 00:02:29.117 SYMLINK libspdk_virtio.so 00:02:29.376 CC lib/event/app.o 00:02:29.376 CC lib/event/reactor.o 00:02:29.376 CC lib/event/log_rpc.o 00:02:29.376 CC lib/event/app_rpc.o 00:02:29.376 CC lib/event/scheduler_static.o 00:02:29.635 LIB libspdk_accel.a 00:02:29.635 SO libspdk_accel.so.15.0 00:02:29.635 SYMLINK libspdk_accel.so 00:02:29.635 LIB libspdk_event.a 00:02:29.635 LIB libspdk_nvme.a 00:02:29.895 SO libspdk_event.so.13.0 00:02:29.895 SO libspdk_nvme.so.13.0 00:02:29.895 SYMLINK libspdk_event.so 00:02:29.895 CC lib/bdev/bdev.o 00:02:29.895 CC lib/bdev/bdev_rpc.o 00:02:29.895 CC lib/bdev/part.o 00:02:29.895 CC lib/bdev/scsi_nvme.o 00:02:29.895 CC lib/bdev/bdev_zone.o 00:02:30.154 SYMLINK libspdk_nvme.so 00:02:30.722 LIB libspdk_blob.a 00:02:30.722 SO libspdk_blob.so.11.0 00:02:30.982 SYMLINK libspdk_blob.so 00:02:31.242 CC lib/lvol/lvol.o 00:02:31.242 CC lib/blobfs/blobfs.o 00:02:31.242 CC lib/blobfs/tree.o 00:02:31.810 LIB libspdk_bdev.a 00:02:31.810 LIB libspdk_blobfs.a 00:02:31.810 SO libspdk_bdev.so.15.0 00:02:31.810 LIB libspdk_lvol.a 00:02:31.810 SO libspdk_blobfs.so.10.0 00:02:31.810 SO libspdk_lvol.so.10.0 00:02:31.810 SYMLINK libspdk_bdev.so 00:02:31.810 SYMLINK libspdk_blobfs.so 00:02:31.810 SYMLINK libspdk_lvol.so 00:02:32.380 CC lib/nvmf/ctrlr.o 00:02:32.380 CC lib/nvmf/ctrlr_bdev.o 00:02:32.380 CC lib/nvmf/ctrlr_discovery.o 00:02:32.380 CC lib/nvmf/nvmf.o 00:02:32.380 CC lib/nvmf/subsystem.o 00:02:32.380 CC lib/ublk/ublk.o 00:02:32.380 CC lib/nvmf/transport.o 00:02:32.380 CC lib/ublk/ublk_rpc.o 00:02:32.380 CC lib/nbd/nbd.o 00:02:32.380 CC lib/nvmf/nvmf_rpc.o 00:02:32.380 CC lib/nvmf/tcp.o 00:02:32.380 CC lib/nbd/nbd_rpc.o 00:02:32.380 CC lib/nvmf/rdma.o 00:02:32.380 CC lib/scsi/dev.o 00:02:32.380 CC lib/scsi/lun.o 00:02:32.380 CC lib/scsi/port.o 00:02:32.380 CC lib/scsi/scsi.o 00:02:32.380 CC lib/scsi/scsi_bdev.o 00:02:32.380 CC lib/scsi/scsi_rpc.o 00:02:32.380 CC lib/scsi/scsi_pr.o 00:02:32.380 CC lib/scsi/task.o 00:02:32.380 CC lib/ftl/ftl_core.o 00:02:32.380 CC lib/ftl/ftl_init.o 00:02:32.380 CC lib/ftl/ftl_layout.o 00:02:32.380 CC lib/ftl/ftl_debug.o 00:02:32.380 CC lib/ftl/ftl_io.o 00:02:32.380 CC lib/ftl/ftl_sb.o 00:02:32.380 CC lib/ftl/ftl_nv_cache.o 00:02:32.380 CC lib/ftl/ftl_l2p.o 00:02:32.380 CC lib/ftl/ftl_l2p_flat.o 00:02:32.380 CC lib/ftl/ftl_band.o 00:02:32.380 CC lib/ftl/ftl_writer.o 00:02:32.380 CC lib/ftl/ftl_band_ops.o 00:02:32.380 CC lib/ftl/ftl_rq.o 00:02:32.380 CC lib/ftl/ftl_reloc.o 00:02:32.380 CC lib/ftl/ftl_l2p_cache.o 00:02:32.380 CC lib/ftl/ftl_p2l.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:32.380 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:32.380 CC lib/ftl/utils/ftl_conf.o 00:02:32.380 CC lib/ftl/utils/ftl_md.o 00:02:32.380 CC lib/ftl/utils/ftl_mempool.o 00:02:32.380 CC lib/ftl/utils/ftl_bitmap.o 00:02:32.380 CC lib/ftl/utils/ftl_property.o 00:02:32.380 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:32.380 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:32.380 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:32.380 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:32.380 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:32.380 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:32.380 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:32.380 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:32.380 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:32.380 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:32.380 CC lib/ftl/base/ftl_base_dev.o 00:02:32.380 CC lib/ftl/base/ftl_base_bdev.o 00:02:32.380 CC lib/ftl/ftl_trace.o 00:02:32.947 LIB libspdk_scsi.a 00:02:32.947 LIB libspdk_nbd.a 00:02:32.947 SO libspdk_scsi.so.9.0 00:02:32.947 SO libspdk_nbd.so.7.0 00:02:32.947 SYMLINK libspdk_nbd.so 00:02:32.947 SYMLINK libspdk_scsi.so 00:02:32.947 LIB libspdk_ublk.a 00:02:32.947 SO libspdk_ublk.so.3.0 00:02:33.206 SYMLINK libspdk_ublk.so 00:02:33.206 LIB libspdk_ftl.a 00:02:33.206 CC lib/iscsi/md5.o 00:02:33.206 CC lib/iscsi/conn.o 00:02:33.206 CC lib/iscsi/init_grp.o 00:02:33.206 CC lib/vhost/vhost.o 00:02:33.206 CC lib/iscsi/iscsi.o 00:02:33.206 CC lib/iscsi/tgt_node.o 00:02:33.206 CC lib/vhost/vhost_rpc.o 00:02:33.206 CC lib/iscsi/param.o 00:02:33.206 CC lib/iscsi/iscsi_rpc.o 00:02:33.206 CC lib/vhost/vhost_scsi.o 00:02:33.206 CC lib/iscsi/portal_grp.o 00:02:33.206 CC lib/vhost/vhost_blk.o 00:02:33.206 CC lib/iscsi/iscsi_subsystem.o 00:02:33.206 CC lib/vhost/rte_vhost_user.o 00:02:33.206 CC lib/iscsi/task.o 00:02:33.466 SO libspdk_ftl.so.9.0 00:02:33.724 SYMLINK libspdk_ftl.so 00:02:33.983 LIB libspdk_nvmf.a 00:02:33.983 LIB libspdk_vhost.a 00:02:33.983 SO libspdk_nvmf.so.18.0 00:02:34.242 SO libspdk_vhost.so.8.0 00:02:34.242 SYMLINK libspdk_vhost.so 00:02:34.242 SYMLINK libspdk_nvmf.so 00:02:34.242 LIB libspdk_iscsi.a 00:02:34.242 SO libspdk_iscsi.so.8.0 00:02:34.501 SYMLINK libspdk_iscsi.so 00:02:35.071 CC module/env_dpdk/env_dpdk_rpc.o 00:02:35.071 LIB libspdk_env_dpdk_rpc.a 00:02:35.071 CC module/accel/iaa/accel_iaa.o 00:02:35.071 CC module/accel/iaa/accel_iaa_rpc.o 00:02:35.071 CC module/sock/posix/posix.o 00:02:35.330 CC module/scheduler/gscheduler/gscheduler.o 00:02:35.330 SO libspdk_env_dpdk_rpc.so.6.0 00:02:35.330 CC module/accel/dsa/accel_dsa.o 00:02:35.330 CC module/accel/dsa/accel_dsa_rpc.o 00:02:35.330 CC module/accel/error/accel_error.o 00:02:35.330 CC module/keyring/file/keyring.o 00:02:35.330 CC module/accel/error/accel_error_rpc.o 00:02:35.330 CC module/keyring/file/keyring_rpc.o 00:02:35.330 CC module/blob/bdev/blob_bdev.o 00:02:35.330 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:35.330 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:35.330 CC module/accel/ioat/accel_ioat.o 00:02:35.330 CC module/accel/ioat/accel_ioat_rpc.o 00:02:35.330 SYMLINK libspdk_env_dpdk_rpc.so 00:02:35.330 LIB libspdk_scheduler_gscheduler.a 00:02:35.330 LIB libspdk_keyring_file.a 00:02:35.330 LIB libspdk_scheduler_dpdk_governor.a 00:02:35.330 LIB libspdk_accel_iaa.a 00:02:35.330 SO libspdk_scheduler_gscheduler.so.4.0 00:02:35.330 SO libspdk_keyring_file.so.1.0 00:02:35.330 LIB libspdk_accel_error.a 00:02:35.330 LIB libspdk_accel_ioat.a 00:02:35.330 SO libspdk_accel_iaa.so.3.0 00:02:35.330 LIB libspdk_scheduler_dynamic.a 00:02:35.330 SO libspdk_scheduler_dpdk_governor.so.4.0 00:02:35.330 LIB libspdk_accel_dsa.a 00:02:35.330 SYMLINK libspdk_scheduler_gscheduler.so 00:02:35.330 SO libspdk_accel_ioat.so.6.0 00:02:35.330 SO libspdk_accel_error.so.2.0 00:02:35.330 SYMLINK libspdk_keyring_file.so 00:02:35.330 SO libspdk_scheduler_dynamic.so.4.0 00:02:35.589 SO libspdk_accel_dsa.so.5.0 00:02:35.589 LIB libspdk_blob_bdev.a 00:02:35.589 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:35.589 SYMLINK libspdk_accel_iaa.so 00:02:35.589 SYMLINK libspdk_accel_error.so 00:02:35.589 SYMLINK libspdk_accel_ioat.so 00:02:35.589 SO libspdk_blob_bdev.so.11.0 00:02:35.589 SYMLINK libspdk_scheduler_dynamic.so 00:02:35.589 SYMLINK libspdk_accel_dsa.so 00:02:35.589 SYMLINK libspdk_blob_bdev.so 00:02:35.848 LIB libspdk_sock_posix.a 00:02:35.848 SO libspdk_sock_posix.so.6.0 00:02:35.848 SYMLINK libspdk_sock_posix.so 00:02:36.106 CC module/bdev/nvme/bdev_nvme.o 00:02:36.106 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:36.106 CC module/bdev/nvme/bdev_mdns_client.o 00:02:36.106 CC module/bdev/nvme/nvme_rpc.o 00:02:36.106 CC module/bdev/nvme/vbdev_opal.o 00:02:36.106 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:36.106 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:36.106 CC module/bdev/gpt/gpt.o 00:02:36.106 CC module/bdev/gpt/vbdev_gpt.o 00:02:36.106 CC module/bdev/raid/bdev_raid.o 00:02:36.106 CC module/bdev/raid/bdev_raid_rpc.o 00:02:36.106 CC module/bdev/raid/bdev_raid_sb.o 00:02:36.106 CC module/bdev/lvol/vbdev_lvol.o 00:02:36.106 CC module/bdev/raid/raid0.o 00:02:36.106 CC module/bdev/error/vbdev_error_rpc.o 00:02:36.106 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:36.106 CC module/bdev/error/vbdev_error.o 00:02:36.106 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:36.106 CC module/bdev/raid/raid1.o 00:02:36.106 CC module/blobfs/bdev/blobfs_bdev.o 00:02:36.106 CC module/bdev/raid/concat.o 00:02:36.106 CC module/bdev/aio/bdev_aio.o 00:02:36.106 CC module/bdev/aio/bdev_aio_rpc.o 00:02:36.106 CC module/bdev/malloc/bdev_malloc.o 00:02:36.106 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:36.106 CC module/bdev/split/vbdev_split.o 00:02:36.106 CC module/bdev/null/bdev_null.o 00:02:36.106 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:36.106 CC module/bdev/null/bdev_null_rpc.o 00:02:36.106 CC module/bdev/split/vbdev_split_rpc.o 00:02:36.106 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:36.106 CC module/bdev/ftl/bdev_ftl.o 00:02:36.106 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:36.106 CC module/bdev/delay/vbdev_delay.o 00:02:36.106 CC module/bdev/iscsi/bdev_iscsi.o 00:02:36.106 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:36.106 CC module/bdev/passthru/vbdev_passthru.o 00:02:36.106 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:36.106 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:36.106 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:36.106 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:36.106 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:36.365 LIB libspdk_blobfs_bdev.a 00:02:36.365 SO libspdk_blobfs_bdev.so.6.0 00:02:36.365 LIB libspdk_bdev_split.a 00:02:36.365 LIB libspdk_bdev_gpt.a 00:02:36.365 LIB libspdk_bdev_null.a 00:02:36.365 LIB libspdk_bdev_error.a 00:02:36.365 SYMLINK libspdk_blobfs_bdev.so 00:02:36.365 SO libspdk_bdev_gpt.so.6.0 00:02:36.365 SO libspdk_bdev_null.so.6.0 00:02:36.365 SO libspdk_bdev_split.so.6.0 00:02:36.365 LIB libspdk_bdev_ftl.a 00:02:36.365 SO libspdk_bdev_error.so.6.0 00:02:36.365 LIB libspdk_bdev_zone_block.a 00:02:36.365 SYMLINK libspdk_bdev_null.so 00:02:36.365 SYMLINK libspdk_bdev_gpt.so 00:02:36.365 SYMLINK libspdk_bdev_split.so 00:02:36.365 LIB libspdk_bdev_iscsi.a 00:02:36.365 SO libspdk_bdev_ftl.so.6.0 00:02:36.365 LIB libspdk_bdev_passthru.a 00:02:36.365 LIB libspdk_bdev_delay.a 00:02:36.365 SO libspdk_bdev_zone_block.so.6.0 00:02:36.365 LIB libspdk_bdev_malloc.a 00:02:36.365 SYMLINK libspdk_bdev_error.so 00:02:36.365 SO libspdk_bdev_passthru.so.6.0 00:02:36.365 SO libspdk_bdev_delay.so.6.0 00:02:36.365 SO libspdk_bdev_iscsi.so.6.0 00:02:36.365 SO libspdk_bdev_malloc.so.6.0 00:02:36.365 LIB libspdk_bdev_aio.a 00:02:36.625 LIB libspdk_bdev_lvol.a 00:02:36.625 SYMLINK libspdk_bdev_ftl.so 00:02:36.625 SYMLINK libspdk_bdev_zone_block.so 00:02:36.625 SO libspdk_bdev_aio.so.6.0 00:02:36.625 SO libspdk_bdev_lvol.so.6.0 00:02:36.625 SYMLINK libspdk_bdev_delay.so 00:02:36.625 SYMLINK libspdk_bdev_malloc.so 00:02:36.625 SYMLINK libspdk_bdev_passthru.so 00:02:36.625 SYMLINK libspdk_bdev_iscsi.so 00:02:36.625 LIB libspdk_bdev_virtio.a 00:02:36.625 SYMLINK libspdk_bdev_aio.so 00:02:36.625 SYMLINK libspdk_bdev_lvol.so 00:02:36.625 SO libspdk_bdev_virtio.so.6.0 00:02:36.625 SYMLINK libspdk_bdev_virtio.so 00:02:36.885 LIB libspdk_bdev_raid.a 00:02:36.885 SO libspdk_bdev_raid.so.6.0 00:02:37.144 SYMLINK libspdk_bdev_raid.so 00:02:37.713 LIB libspdk_bdev_nvme.a 00:02:37.713 SO libspdk_bdev_nvme.so.7.0 00:02:37.713 SYMLINK libspdk_bdev_nvme.so 00:02:38.651 CC module/event/subsystems/sock/sock.o 00:02:38.651 CC module/event/subsystems/iobuf/iobuf.o 00:02:38.651 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:38.651 CC module/event/subsystems/vmd/vmd.o 00:02:38.651 CC module/event/subsystems/scheduler/scheduler.o 00:02:38.651 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:38.651 CC module/event/subsystems/keyring/keyring.o 00:02:38.651 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:38.651 LIB libspdk_event_sock.a 00:02:38.651 LIB libspdk_event_scheduler.a 00:02:38.651 LIB libspdk_event_vhost_blk.a 00:02:38.651 LIB libspdk_event_vmd.a 00:02:38.651 LIB libspdk_event_keyring.a 00:02:38.651 SO libspdk_event_sock.so.5.0 00:02:38.651 LIB libspdk_event_iobuf.a 00:02:38.651 SO libspdk_event_scheduler.so.4.0 00:02:38.651 SO libspdk_event_vmd.so.6.0 00:02:38.651 SO libspdk_event_vhost_blk.so.3.0 00:02:38.651 SO libspdk_event_keyring.so.1.0 00:02:38.651 SO libspdk_event_iobuf.so.3.0 00:02:38.651 SYMLINK libspdk_event_sock.so 00:02:38.651 SYMLINK libspdk_event_scheduler.so 00:02:38.910 SYMLINK libspdk_event_vhost_blk.so 00:02:38.910 SYMLINK libspdk_event_vmd.so 00:02:38.910 SYMLINK libspdk_event_keyring.so 00:02:38.910 SYMLINK libspdk_event_iobuf.so 00:02:39.171 CC module/event/subsystems/accel/accel.o 00:02:39.171 LIB libspdk_event_accel.a 00:02:39.171 SO libspdk_event_accel.so.6.0 00:02:39.430 SYMLINK libspdk_event_accel.so 00:02:39.690 CC module/event/subsystems/bdev/bdev.o 00:02:39.949 LIB libspdk_event_bdev.a 00:02:39.949 SO libspdk_event_bdev.so.6.0 00:02:39.949 SYMLINK libspdk_event_bdev.so 00:02:40.209 CC module/event/subsystems/ublk/ublk.o 00:02:40.209 CC module/event/subsystems/nbd/nbd.o 00:02:40.209 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:40.209 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:40.209 CC module/event/subsystems/scsi/scsi.o 00:02:40.469 LIB libspdk_event_ublk.a 00:02:40.469 LIB libspdk_event_nbd.a 00:02:40.469 LIB libspdk_event_scsi.a 00:02:40.469 SO libspdk_event_ublk.so.3.0 00:02:40.469 SO libspdk_event_nbd.so.6.0 00:02:40.469 SO libspdk_event_scsi.so.6.0 00:02:40.469 LIB libspdk_event_nvmf.a 00:02:40.469 SYMLINK libspdk_event_ublk.so 00:02:40.469 SO libspdk_event_nvmf.so.6.0 00:02:40.469 SYMLINK libspdk_event_nbd.so 00:02:40.469 SYMLINK libspdk_event_scsi.so 00:02:40.729 SYMLINK libspdk_event_nvmf.so 00:02:40.989 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:40.989 CC module/event/subsystems/iscsi/iscsi.o 00:02:40.989 LIB libspdk_event_vhost_scsi.a 00:02:40.989 SO libspdk_event_vhost_scsi.so.3.0 00:02:40.989 LIB libspdk_event_iscsi.a 00:02:40.989 SYMLINK libspdk_event_vhost_scsi.so 00:02:41.249 SO libspdk_event_iscsi.so.6.0 00:02:41.249 SYMLINK libspdk_event_iscsi.so 00:02:41.509 SO libspdk.so.6.0 00:02:41.509 SYMLINK libspdk.so 00:02:41.779 TEST_HEADER include/spdk/accel.h 00:02:41.779 TEST_HEADER include/spdk/accel_module.h 00:02:41.779 CC test/rpc_client/rpc_client_test.o 00:02:41.779 TEST_HEADER include/spdk/assert.h 00:02:41.779 TEST_HEADER include/spdk/barrier.h 00:02:41.779 TEST_HEADER include/spdk/base64.h 00:02:41.779 TEST_HEADER include/spdk/bdev.h 00:02:41.779 TEST_HEADER include/spdk/bdev_module.h 00:02:41.779 TEST_HEADER include/spdk/bdev_zone.h 00:02:41.779 TEST_HEADER include/spdk/bit_array.h 00:02:41.779 TEST_HEADER include/spdk/bit_pool.h 00:02:41.779 TEST_HEADER include/spdk/blob_bdev.h 00:02:41.779 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:41.779 TEST_HEADER include/spdk/blobfs.h 00:02:41.779 TEST_HEADER include/spdk/blob.h 00:02:41.779 CC app/trace_record/trace_record.o 00:02:41.779 TEST_HEADER include/spdk/config.h 00:02:41.779 CC app/spdk_top/spdk_top.o 00:02:41.779 CXX app/trace/trace.o 00:02:41.779 TEST_HEADER include/spdk/conf.h 00:02:41.779 TEST_HEADER include/spdk/cpuset.h 00:02:41.779 CC app/spdk_nvme_perf/perf.o 00:02:41.779 TEST_HEADER include/spdk/crc16.h 00:02:41.779 CC app/spdk_nvme_identify/identify.o 00:02:41.779 CC app/spdk_lspci/spdk_lspci.o 00:02:41.779 TEST_HEADER include/spdk/crc64.h 00:02:41.779 CC app/spdk_nvme_discover/discovery_aer.o 00:02:41.779 TEST_HEADER include/spdk/crc32.h 00:02:41.779 TEST_HEADER include/spdk/dif.h 00:02:41.779 TEST_HEADER include/spdk/dma.h 00:02:41.779 TEST_HEADER include/spdk/endian.h 00:02:41.779 TEST_HEADER include/spdk/env_dpdk.h 00:02:41.779 TEST_HEADER include/spdk/env.h 00:02:41.779 TEST_HEADER include/spdk/event.h 00:02:41.779 TEST_HEADER include/spdk/fd_group.h 00:02:41.779 TEST_HEADER include/spdk/fd.h 00:02:41.779 TEST_HEADER include/spdk/file.h 00:02:41.779 TEST_HEADER include/spdk/ftl.h 00:02:41.779 TEST_HEADER include/spdk/gpt_spec.h 00:02:41.779 TEST_HEADER include/spdk/hexlify.h 00:02:41.779 TEST_HEADER include/spdk/histogram_data.h 00:02:41.779 TEST_HEADER include/spdk/idxd.h 00:02:41.779 TEST_HEADER include/spdk/idxd_spec.h 00:02:41.779 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:41.779 TEST_HEADER include/spdk/init.h 00:02:41.779 TEST_HEADER include/spdk/ioat.h 00:02:41.779 CC app/spdk_dd/spdk_dd.o 00:02:41.779 CC app/nvmf_tgt/nvmf_main.o 00:02:41.779 TEST_HEADER include/spdk/ioat_spec.h 00:02:41.779 CC app/iscsi_tgt/iscsi_tgt.o 00:02:41.779 TEST_HEADER include/spdk/iscsi_spec.h 00:02:41.779 TEST_HEADER include/spdk/json.h 00:02:41.779 TEST_HEADER include/spdk/jsonrpc.h 00:02:41.779 TEST_HEADER include/spdk/keyring.h 00:02:41.779 TEST_HEADER include/spdk/keyring_module.h 00:02:41.779 CC app/vhost/vhost.o 00:02:41.779 TEST_HEADER include/spdk/likely.h 00:02:41.779 TEST_HEADER include/spdk/log.h 00:02:41.779 CC app/spdk_tgt/spdk_tgt.o 00:02:41.779 TEST_HEADER include/spdk/lvol.h 00:02:41.779 TEST_HEADER include/spdk/memory.h 00:02:41.779 TEST_HEADER include/spdk/mmio.h 00:02:41.779 CC test/env/vtophys/vtophys.o 00:02:41.780 TEST_HEADER include/spdk/nbd.h 00:02:42.040 CC test/app/jsoncat/jsoncat.o 00:02:42.040 CC test/app/stub/stub.o 00:02:42.040 TEST_HEADER include/spdk/notify.h 00:02:42.040 TEST_HEADER include/spdk/nvme.h 00:02:42.040 TEST_HEADER include/spdk/nvme_intel.h 00:02:42.040 CC test/env/memory/memory_ut.o 00:02:42.040 CC test/nvme/sgl/sgl.o 00:02:42.040 CC test/event/reactor/reactor.o 00:02:42.040 CC test/thread/poller_perf/poller_perf.o 00:02:42.040 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:42.040 CC test/app/histogram_perf/histogram_perf.o 00:02:42.040 CC test/env/pci/pci_ut.o 00:02:42.040 CC examples/ioat/verify/verify.o 00:02:42.040 CC test/nvme/overhead/overhead.o 00:02:42.040 CC test/nvme/reset/reset.o 00:02:42.040 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:42.040 CC test/nvme/connect_stress/connect_stress.o 00:02:42.040 CC test/nvme/reserve/reserve.o 00:02:42.040 CC test/event/event_perf/event_perf.o 00:02:42.040 CC test/nvme/aer/aer.o 00:02:42.040 CC test/event/reactor_perf/reactor_perf.o 00:02:42.040 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:42.040 CC examples/sock/hello_world/hello_sock.o 00:02:42.040 CC test/nvme/e2edp/nvme_dp.o 00:02:42.040 CC examples/nvme/hello_world/hello_world.o 00:02:42.040 CC examples/vmd/lsvmd/lsvmd.o 00:02:42.040 TEST_HEADER include/spdk/nvme_spec.h 00:02:42.040 CC test/nvme/fused_ordering/fused_ordering.o 00:02:42.040 CC examples/nvme/reconnect/reconnect.o 00:02:42.040 CC examples/accel/perf/accel_perf.o 00:02:42.040 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:42.040 TEST_HEADER include/spdk/nvme_zns.h 00:02:42.040 CC app/fio/nvme/fio_plugin.o 00:02:42.040 CC examples/ioat/perf/perf.o 00:02:42.040 CC test/nvme/err_injection/err_injection.o 00:02:42.040 CC test/nvme/startup/startup.o 00:02:42.040 CC examples/vmd/led/led.o 00:02:42.040 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:42.040 CC examples/idxd/perf/perf.o 00:02:42.040 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:42.040 CC test/nvme/boot_partition/boot_partition.o 00:02:42.040 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:42.040 CC test/nvme/simple_copy/simple_copy.o 00:02:42.040 CC examples/util/zipf/zipf.o 00:02:42.040 CC test/nvme/cuse/cuse.o 00:02:42.040 CC test/event/app_repeat/app_repeat.o 00:02:42.040 CC test/nvme/compliance/nvme_compliance.o 00:02:42.040 CC test/nvme/fdp/fdp.o 00:02:42.040 TEST_HEADER include/spdk/nvmf.h 00:02:42.040 CC examples/nvme/hotplug/hotplug.o 00:02:42.040 TEST_HEADER include/spdk/nvmf_spec.h 00:02:42.040 TEST_HEADER include/spdk/nvmf_transport.h 00:02:42.040 TEST_HEADER include/spdk/opal.h 00:02:42.040 CC examples/nvme/arbitration/arbitration.o 00:02:42.040 TEST_HEADER include/spdk/opal_spec.h 00:02:42.040 CC test/accel/dif/dif.o 00:02:42.040 CC test/app/bdev_svc/bdev_svc.o 00:02:42.040 CC test/blobfs/mkfs/mkfs.o 00:02:42.040 TEST_HEADER include/spdk/pci_ids.h 00:02:42.040 CC test/bdev/bdevio/bdevio.o 00:02:42.040 TEST_HEADER include/spdk/pipe.h 00:02:42.040 CC test/event/scheduler/scheduler.o 00:02:42.040 CC test/dma/test_dma/test_dma.o 00:02:42.040 CC examples/bdev/hello_world/hello_bdev.o 00:02:42.040 CC examples/blob/cli/blobcli.o 00:02:42.040 TEST_HEADER include/spdk/queue.h 00:02:42.040 TEST_HEADER include/spdk/reduce.h 00:02:42.040 TEST_HEADER include/spdk/rpc.h 00:02:42.040 TEST_HEADER include/spdk/scheduler.h 00:02:42.040 CC examples/blob/hello_world/hello_blob.o 00:02:42.040 CC examples/nvmf/nvmf/nvmf.o 00:02:42.040 TEST_HEADER include/spdk/scsi.h 00:02:42.040 CC examples/thread/thread/thread_ex.o 00:02:42.040 TEST_HEADER include/spdk/scsi_spec.h 00:02:42.040 TEST_HEADER include/spdk/sock.h 00:02:42.040 CC examples/bdev/bdevperf/bdevperf.o 00:02:42.040 TEST_HEADER include/spdk/stdinc.h 00:02:42.040 TEST_HEADER include/spdk/string.h 00:02:42.040 TEST_HEADER include/spdk/thread.h 00:02:42.040 TEST_HEADER include/spdk/trace.h 00:02:42.041 TEST_HEADER include/spdk/trace_parser.h 00:02:42.041 TEST_HEADER include/spdk/tree.h 00:02:42.041 TEST_HEADER include/spdk/ublk.h 00:02:42.041 LINK spdk_lspci 00:02:42.041 TEST_HEADER include/spdk/util.h 00:02:42.041 TEST_HEADER include/spdk/uuid.h 00:02:42.041 TEST_HEADER include/spdk/version.h 00:02:42.041 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:42.041 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:42.041 TEST_HEADER include/spdk/vhost.h 00:02:42.041 TEST_HEADER include/spdk/vmd.h 00:02:42.041 TEST_HEADER include/spdk/xor.h 00:02:42.041 CC test/lvol/esnap/esnap.o 00:02:42.041 CC test/env/mem_callbacks/mem_callbacks.o 00:02:42.041 TEST_HEADER include/spdk/zipf.h 00:02:42.041 CXX test/cpp_headers/accel.o 00:02:42.041 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:42.041 LINK rpc_client_test 00:02:42.304 LINK spdk_nvme_discover 00:02:42.304 LINK nvmf_tgt 00:02:42.304 LINK vtophys 00:02:42.304 LINK spdk_trace_record 00:02:42.304 LINK interrupt_tgt 00:02:42.304 LINK jsoncat 00:02:42.304 LINK reactor 00:02:42.304 LINK histogram_perf 00:02:42.304 LINK poller_perf 00:02:42.304 LINK lsvmd 00:02:42.304 LINK event_perf 00:02:42.304 LINK led 00:02:42.304 LINK reactor_perf 00:02:42.304 LINK vhost 00:02:42.304 LINK stub 00:02:42.304 LINK iscsi_tgt 00:02:42.304 LINK zipf 00:02:42.304 LINK boot_partition 00:02:42.304 LINK connect_stress 00:02:42.304 LINK app_repeat 00:02:42.304 LINK env_dpdk_post_init 00:02:42.304 LINK spdk_tgt 00:02:42.304 LINK startup 00:02:42.304 LINK bdev_svc 00:02:42.304 LINK err_injection 00:02:42.304 LINK doorbell_aers 00:02:42.304 LINK verify 00:02:42.304 LINK mkfs 00:02:42.304 LINK fused_ordering 00:02:42.304 LINK reserve 00:02:42.304 LINK hello_world 00:02:42.304 LINK ioat_perf 00:02:42.304 LINK reset 00:02:42.305 LINK scheduler 00:02:42.305 LINK simple_copy 00:02:42.569 LINK hello_sock 00:02:42.569 LINK sgl 00:02:42.569 LINK nvme_dp 00:02:42.569 LINK hotplug 00:02:42.569 LINK hello_blob 00:02:42.569 LINK aer 00:02:42.569 LINK thread 00:02:42.569 LINK hello_bdev 00:02:42.569 LINK spdk_dd 00:02:42.569 LINK overhead 00:02:42.569 CXX test/cpp_headers/accel_module.o 00:02:42.569 LINK nvme_compliance 00:02:42.569 CXX test/cpp_headers/assert.o 00:02:42.569 LINK fdp 00:02:42.569 CXX test/cpp_headers/barrier.o 00:02:42.569 LINK nvmf 00:02:42.569 LINK spdk_trace 00:02:42.569 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:42.569 LINK reconnect 00:02:42.569 LINK idxd_perf 00:02:42.569 CXX test/cpp_headers/base64.o 00:02:42.569 LINK arbitration 00:02:42.569 CXX test/cpp_headers/bdev.o 00:02:42.569 CXX test/cpp_headers/bdev_module.o 00:02:42.569 CXX test/cpp_headers/bdev_zone.o 00:02:42.569 CXX test/cpp_headers/bit_array.o 00:02:42.569 CXX test/cpp_headers/bit_pool.o 00:02:42.569 LINK dif 00:02:42.569 CXX test/cpp_headers/blob_bdev.o 00:02:42.569 CXX test/cpp_headers/blobfs_bdev.o 00:02:42.569 LINK pci_ut 00:02:42.569 CXX test/cpp_headers/blobfs.o 00:02:42.569 CXX test/cpp_headers/blob.o 00:02:42.569 LINK test_dma 00:02:42.569 LINK bdevio 00:02:42.569 CXX test/cpp_headers/conf.o 00:02:42.569 CXX test/cpp_headers/config.o 00:02:42.569 CXX test/cpp_headers/cpuset.o 00:02:42.569 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:42.569 CXX test/cpp_headers/crc16.o 00:02:42.833 CXX test/cpp_headers/crc32.o 00:02:42.833 CXX test/cpp_headers/crc64.o 00:02:42.833 CXX test/cpp_headers/dif.o 00:02:42.833 CXX test/cpp_headers/dma.o 00:02:42.833 CXX test/cpp_headers/endian.o 00:02:42.833 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:42.833 CXX test/cpp_headers/env_dpdk.o 00:02:42.833 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:42.833 CXX test/cpp_headers/event.o 00:02:42.833 CXX test/cpp_headers/env.o 00:02:42.833 CXX test/cpp_headers/fd_group.o 00:02:42.834 CXX test/cpp_headers/fd.o 00:02:42.834 LINK accel_perf 00:02:42.834 CXX test/cpp_headers/file.o 00:02:42.834 CXX test/cpp_headers/ftl.o 00:02:42.834 CC examples/nvme/abort/abort.o 00:02:42.834 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:42.834 CXX test/cpp_headers/gpt_spec.o 00:02:42.834 CXX test/cpp_headers/hexlify.o 00:02:42.834 CXX test/cpp_headers/idxd.o 00:02:42.834 CXX test/cpp_headers/histogram_data.o 00:02:42.834 CC app/fio/bdev/fio_plugin.o 00:02:42.834 CXX test/cpp_headers/idxd_spec.o 00:02:42.834 CXX test/cpp_headers/init.o 00:02:42.834 CXX test/cpp_headers/ioat.o 00:02:42.834 CXX test/cpp_headers/ioat_spec.o 00:02:42.834 LINK nvme_fuzz 00:02:42.834 LINK nvme_manage 00:02:42.834 CXX test/cpp_headers/iscsi_spec.o 00:02:42.834 CXX test/cpp_headers/json.o 00:02:42.834 CXX test/cpp_headers/jsonrpc.o 00:02:42.834 CXX test/cpp_headers/keyring.o 00:02:42.834 LINK blobcli 00:02:42.834 CXX test/cpp_headers/keyring_module.o 00:02:42.834 CXX test/cpp_headers/likely.o 00:02:42.834 CXX test/cpp_headers/log.o 00:02:42.834 CXX test/cpp_headers/lvol.o 00:02:42.834 CXX test/cpp_headers/memory.o 00:02:42.834 CXX test/cpp_headers/mmio.o 00:02:42.834 CXX test/cpp_headers/nbd.o 00:02:42.834 CXX test/cpp_headers/notify.o 00:02:42.834 LINK spdk_nvme 00:02:42.834 CXX test/cpp_headers/nvme.o 00:02:42.834 CXX test/cpp_headers/nvme_intel.o 00:02:42.834 CXX test/cpp_headers/nvme_ocssd.o 00:02:42.834 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:42.834 LINK cmb_copy 00:02:43.098 CXX test/cpp_headers/nvme_spec.o 00:02:43.098 CXX test/cpp_headers/nvme_zns.o 00:02:43.098 CXX test/cpp_headers/nvmf_cmd.o 00:02:43.098 CXX test/cpp_headers/nvmf.o 00:02:43.098 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:43.098 LINK mem_callbacks 00:02:43.098 CXX test/cpp_headers/nvmf_spec.o 00:02:43.098 CXX test/cpp_headers/nvmf_transport.o 00:02:43.098 CXX test/cpp_headers/opal.o 00:02:43.098 CXX test/cpp_headers/pci_ids.o 00:02:43.098 CXX test/cpp_headers/opal_spec.o 00:02:43.098 CXX test/cpp_headers/pipe.o 00:02:43.098 LINK spdk_nvme_perf 00:02:43.098 CXX test/cpp_headers/queue.o 00:02:43.098 CXX test/cpp_headers/reduce.o 00:02:43.098 CXX test/cpp_headers/rpc.o 00:02:43.098 CXX test/cpp_headers/scheduler.o 00:02:43.098 CXX test/cpp_headers/scsi.o 00:02:43.098 LINK spdk_nvme_identify 00:02:43.098 LINK spdk_top 00:02:43.098 CXX test/cpp_headers/scsi_spec.o 00:02:43.098 CXX test/cpp_headers/sock.o 00:02:43.098 CXX test/cpp_headers/stdinc.o 00:02:43.098 CXX test/cpp_headers/string.o 00:02:43.098 CXX test/cpp_headers/thread.o 00:02:43.098 CXX test/cpp_headers/trace.o 00:02:43.098 CXX test/cpp_headers/trace_parser.o 00:02:43.098 CXX test/cpp_headers/tree.o 00:02:43.356 LINK bdevperf 00:02:43.357 CXX test/cpp_headers/ublk.o 00:02:43.357 CXX test/cpp_headers/util.o 00:02:43.357 CXX test/cpp_headers/uuid.o 00:02:43.357 CXX test/cpp_headers/version.o 00:02:43.357 LINK pmr_persistence 00:02:43.357 CXX test/cpp_headers/vfio_user_pci.o 00:02:43.357 CXX test/cpp_headers/vfio_user_spec.o 00:02:43.357 CXX test/cpp_headers/vhost.o 00:02:43.357 CXX test/cpp_headers/vmd.o 00:02:43.357 CXX test/cpp_headers/xor.o 00:02:43.357 CXX test/cpp_headers/zipf.o 00:02:43.357 LINK memory_ut 00:02:43.357 LINK abort 00:02:43.357 LINK vhost_fuzz 00:02:43.627 LINK cuse 00:02:43.627 LINK spdk_bdev 00:02:44.567 LINK iscsi_fuzz 00:02:46.474 LINK esnap 00:02:46.474 00:02:46.474 real 0m48.358s 00:02:46.474 user 6m49.076s 00:02:46.474 sys 3m21.324s 00:02:46.474 15:03:50 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:46.474 15:03:50 -- common/autotest_common.sh@10 -- $ set +x 00:02:46.474 ************************************ 00:02:46.474 END TEST make 00:02:46.474 ************************************ 00:02:46.474 15:03:50 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:46.474 15:03:50 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:46.474 15:03:50 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:46.474 15:03:50 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.474 15:03:50 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:46.474 15:03:50 -- pm/common@45 -- $ pid=384806 00:02:46.474 15:03:50 -- pm/common@52 -- $ sudo kill -TERM 384806 00:02:46.474 15:03:50 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.474 15:03:50 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:46.474 15:03:50 -- pm/common@45 -- $ pid=384807 00:02:46.474 15:03:50 -- pm/common@52 -- $ sudo kill -TERM 384807 00:02:46.474 15:03:50 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.474 15:03:50 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:46.474 15:03:50 -- pm/common@45 -- $ pid=384808 00:02:46.474 15:03:50 -- pm/common@52 -- $ sudo kill -TERM 384808 00:02:46.735 15:03:50 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.735 15:03:50 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:46.735 15:03:50 -- pm/common@45 -- $ pid=384809 00:02:46.735 15:03:50 -- pm/common@52 -- $ sudo kill -TERM 384809 00:02:46.735 15:03:50 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:02:46.735 15:03:50 -- nvmf/common.sh@7 -- # uname -s 00:02:46.735 15:03:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:46.735 15:03:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:46.735 15:03:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:46.735 15:03:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:46.735 15:03:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:46.735 15:03:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:46.735 15:03:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:46.735 15:03:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:46.735 15:03:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:46.735 15:03:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:46.735 15:03:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:02:46.735 15:03:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:02:46.735 15:03:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:46.735 15:03:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:46.735 15:03:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:46.735 15:03:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:46.735 15:03:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:02:46.735 15:03:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:46.735 15:03:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:46.735 15:03:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:46.735 15:03:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:46.735 15:03:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:46.735 15:03:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:46.735 15:03:50 -- paths/export.sh@5 -- # export PATH 00:02:46.735 15:03:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:46.735 15:03:50 -- nvmf/common.sh@47 -- # : 0 00:02:46.735 15:03:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:46.735 15:03:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:46.735 15:03:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:46.735 15:03:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:46.735 15:03:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:46.735 15:03:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:46.735 15:03:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:46.735 15:03:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:46.735 15:03:50 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:46.735 15:03:50 -- spdk/autotest.sh@32 -- # uname -s 00:02:46.735 15:03:50 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:46.735 15:03:50 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:46.735 15:03:50 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/coredumps 00:02:46.735 15:03:50 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:46.735 15:03:50 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/coredumps 00:02:46.735 15:03:50 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:46.735 15:03:50 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:46.735 15:03:50 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:46.735 15:03:50 -- spdk/autotest.sh@48 -- # udevadm_pid=441811 00:02:46.735 15:03:50 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:46.735 15:03:50 -- pm/common@17 -- # local monitor 00:02:46.735 15:03:50 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.735 15:03:50 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=441812 00:02:46.735 15:03:50 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.735 15:03:50 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:46.735 15:03:50 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=441814 00:02:46.735 15:03:50 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.735 15:03:50 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=441815 00:02:46.735 15:03:50 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:46.735 15:03:50 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=441816 00:02:46.735 15:03:50 -- pm/common@26 -- # sleep 1 00:02:46.735 15:03:50 -- pm/common@21 -- # date +%s 00:02:46.735 15:03:50 -- pm/common@21 -- # date +%s 00:02:46.735 15:03:50 -- pm/common@21 -- # date +%s 00:02:46.735 15:03:50 -- pm/common@21 -- # date +%s 00:02:46.735 15:03:50 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713963830 00:02:46.735 15:03:50 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713963830 00:02:46.735 15:03:50 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713963830 00:02:46.735 15:03:50 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1713963830 00:02:46.735 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713963830_collect-vmstat.pm.log 00:02:46.735 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713963830_collect-bmc-pm.bmc.pm.log 00:02:46.735 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713963830_collect-cpu-load.pm.log 00:02:46.735 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autotest.sh.1713963830_collect-cpu-temp.pm.log 00:02:47.674 15:03:51 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:47.674 15:03:51 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:47.674 15:03:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:47.674 15:03:51 -- common/autotest_common.sh@10 -- # set +x 00:02:47.674 15:03:51 -- spdk/autotest.sh@59 -- # create_test_list 00:02:47.674 15:03:51 -- common/autotest_common.sh@734 -- # xtrace_disable 00:02:47.674 15:03:51 -- common/autotest_common.sh@10 -- # set +x 00:02:47.933 15:03:51 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/autotest.sh 00:02:47.933 15:03:51 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:02:47.933 15:03:51 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:02:47.933 15:03:51 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:02:47.933 15:03:51 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:02:47.933 15:03:51 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:47.933 15:03:51 -- common/autotest_common.sh@1441 -- # uname 00:02:47.933 15:03:51 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:02:47.933 15:03:51 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:47.933 15:03:51 -- common/autotest_common.sh@1461 -- # uname 00:02:47.933 15:03:51 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:02:47.933 15:03:51 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:47.933 15:03:51 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:47.933 15:03:51 -- spdk/autotest.sh@72 -- # hash lcov 00:02:47.933 15:03:51 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:47.933 15:03:51 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:47.933 --rc lcov_branch_coverage=1 00:02:47.933 --rc lcov_function_coverage=1 00:02:47.933 --rc genhtml_branch_coverage=1 00:02:47.933 --rc genhtml_function_coverage=1 00:02:47.933 --rc genhtml_legend=1 00:02:47.933 --rc geninfo_all_blocks=1 00:02:47.933 ' 00:02:47.933 15:03:51 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:47.933 --rc lcov_branch_coverage=1 00:02:47.933 --rc lcov_function_coverage=1 00:02:47.933 --rc genhtml_branch_coverage=1 00:02:47.933 --rc genhtml_function_coverage=1 00:02:47.933 --rc genhtml_legend=1 00:02:47.933 --rc geninfo_all_blocks=1 00:02:47.933 ' 00:02:47.934 15:03:51 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:47.934 --rc lcov_branch_coverage=1 00:02:47.934 --rc lcov_function_coverage=1 00:02:47.934 --rc genhtml_branch_coverage=1 00:02:47.934 --rc genhtml_function_coverage=1 00:02:47.934 --rc genhtml_legend=1 00:02:47.934 --rc geninfo_all_blocks=1 00:02:47.934 --no-external' 00:02:47.934 15:03:51 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:47.934 --rc lcov_branch_coverage=1 00:02:47.934 --rc lcov_function_coverage=1 00:02:47.934 --rc genhtml_branch_coverage=1 00:02:47.934 --rc genhtml_function_coverage=1 00:02:47.934 --rc genhtml_legend=1 00:02:47.934 --rc geninfo_all_blocks=1 00:02:47.934 --no-external' 00:02:47.934 15:03:51 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:47.934 lcov: LCOV version 1.14 00:02:47.934 15:03:51 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_base.info 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:54.509 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:54.509 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:54.510 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:54.510 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:54.511 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:54.511 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:54.771 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:54.771 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:58.066 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:58.066 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:03:06.200 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:06.201 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:06.201 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:06.201 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:06.201 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:06.201 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:11.484 15:04:15 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:03:11.484 15:04:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:11.484 15:04:15 -- common/autotest_common.sh@10 -- # set +x 00:03:11.484 15:04:15 -- spdk/autotest.sh@91 -- # rm -f 00:03:11.484 15:04:15 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.781 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:03:14.781 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:03:14.781 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:03:14.781 15:04:18 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:03:14.781 15:04:18 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:14.781 15:04:18 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:14.781 15:04:18 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:14.781 15:04:18 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:14.781 15:04:18 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:14.781 15:04:18 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:14.781 15:04:18 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:14.781 15:04:18 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:14.781 15:04:18 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:03:14.781 15:04:18 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:03:14.781 15:04:18 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:03:14.781 15:04:18 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:03:14.781 15:04:18 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:03:14.781 15:04:18 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:14.781 No valid GPT data, bailing 00:03:14.781 15:04:18 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:15.041 15:04:18 -- scripts/common.sh@391 -- # pt= 00:03:15.041 15:04:18 -- scripts/common.sh@392 -- # return 1 00:03:15.041 15:04:18 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:15.041 1+0 records in 00:03:15.041 1+0 records out 00:03:15.041 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00169508 s, 619 MB/s 00:03:15.041 15:04:18 -- spdk/autotest.sh@118 -- # sync 00:03:15.041 15:04:18 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:15.041 15:04:18 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:15.041 15:04:18 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:19.245 15:04:22 -- spdk/autotest.sh@124 -- # uname -s 00:03:19.245 15:04:22 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:03:19.245 15:04:22 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/test-setup.sh 00:03:19.245 15:04:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.245 15:04:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.245 15:04:22 -- common/autotest_common.sh@10 -- # set +x 00:03:19.245 ************************************ 00:03:19.245 START TEST setup.sh 00:03:19.245 ************************************ 00:03:19.245 15:04:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/test-setup.sh 00:03:19.505 * Looking for test storage... 00:03:19.505 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:03:19.505 15:04:23 -- setup/test-setup.sh@10 -- # uname -s 00:03:19.505 15:04:23 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:19.505 15:04:23 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/acl.sh 00:03:19.505 15:04:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.505 15:04:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.505 15:04:23 -- common/autotest_common.sh@10 -- # set +x 00:03:19.505 ************************************ 00:03:19.505 START TEST acl 00:03:19.505 ************************************ 00:03:19.505 15:04:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/acl.sh 00:03:19.765 * Looking for test storage... 00:03:19.765 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:03:19.765 15:04:23 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:19.765 15:04:23 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:19.765 15:04:23 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:19.765 15:04:23 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:19.765 15:04:23 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:19.765 15:04:23 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:19.765 15:04:23 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:19.765 15:04:23 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:19.765 15:04:23 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:19.765 15:04:23 -- setup/acl.sh@12 -- # devs=() 00:03:19.765 15:04:23 -- setup/acl.sh@12 -- # declare -a devs 00:03:19.765 15:04:23 -- setup/acl.sh@13 -- # drivers=() 00:03:19.765 15:04:23 -- setup/acl.sh@13 -- # declare -A drivers 00:03:19.765 15:04:23 -- setup/acl.sh@51 -- # setup reset 00:03:19.765 15:04:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.765 15:04:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:23.060 15:04:26 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:23.060 15:04:26 -- setup/acl.sh@16 -- # local dev driver 00:03:23.060 15:04:26 -- setup/acl.sh@15 -- # setup output status 00:03:23.060 15:04:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.060 15:04:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:03:23.060 15:04:26 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 Hugepages 00:03:26.356 node hugesize free / total 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 00:03:26.356 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:29 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:29 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:29 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:5e:00.0 == *:*:*.* ]] 00:03:26.356 15:04:30 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:26.356 15:04:30 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:03:26.356 15:04:30 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:26.356 15:04:30 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:26.356 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.356 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:26.356 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.356 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.356 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:26.357 15:04:30 -- setup/acl.sh@20 -- # continue 00:03:26.357 15:04:30 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.357 15:04:30 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:26.357 15:04:30 -- setup/acl.sh@54 -- # run_test denied denied 00:03:26.357 15:04:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.357 15:04:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.357 15:04:30 -- common/autotest_common.sh@10 -- # set +x 00:03:26.617 ************************************ 00:03:26.617 START TEST denied 00:03:26.617 ************************************ 00:03:26.617 15:04:30 -- common/autotest_common.sh@1111 -- # denied 00:03:26.617 15:04:30 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5e:00.0' 00:03:26.617 15:04:30 -- setup/acl.sh@38 -- # setup output config 00:03:26.617 15:04:30 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5e:00.0' 00:03:26.617 15:04:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.617 15:04:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:29.916 0000:5e:00.0 (8086 0a54): Skipping denied controller at 0000:5e:00.0 00:03:29.916 15:04:33 -- setup/acl.sh@40 -- # verify 0000:5e:00.0 00:03:29.916 15:04:33 -- setup/acl.sh@28 -- # local dev driver 00:03:29.916 15:04:33 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:29.916 15:04:33 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5e:00.0 ]] 00:03:29.916 15:04:33 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5e:00.0/driver 00:03:29.916 15:04:33 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:29.916 15:04:33 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:29.916 15:04:33 -- setup/acl.sh@41 -- # setup reset 00:03:29.916 15:04:33 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:29.916 15:04:33 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:35.201 00:03:35.201 real 0m8.323s 00:03:35.201 user 0m2.708s 00:03:35.201 sys 0m4.940s 00:03:35.201 15:04:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:35.201 15:04:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.201 ************************************ 00:03:35.201 END TEST denied 00:03:35.201 ************************************ 00:03:35.201 15:04:38 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:35.201 15:04:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.201 15:04:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.201 15:04:38 -- common/autotest_common.sh@10 -- # set +x 00:03:35.201 ************************************ 00:03:35.201 START TEST allowed 00:03:35.201 ************************************ 00:03:35.201 15:04:38 -- common/autotest_common.sh@1111 -- # allowed 00:03:35.201 15:04:38 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5e:00.0 00:03:35.201 15:04:38 -- setup/acl.sh@46 -- # grep -E '0000:5e:00.0 .*: nvme -> .*' 00:03:35.201 15:04:38 -- setup/acl.sh@45 -- # setup output config 00:03:35.201 15:04:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.201 15:04:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:03:41.778 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:41.778 15:04:45 -- setup/acl.sh@47 -- # verify 00:03:41.778 15:04:45 -- setup/acl.sh@28 -- # local dev driver 00:03:41.778 15:04:45 -- setup/acl.sh@48 -- # setup reset 00:03:41.778 15:04:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:41.778 15:04:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:03:45.981 00:03:45.981 real 0m10.502s 00:03:45.981 user 0m2.512s 00:03:45.981 sys 0m4.807s 00:03:45.981 15:04:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:45.981 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:45.981 ************************************ 00:03:45.981 END TEST allowed 00:03:45.981 ************************************ 00:03:45.981 00:03:45.981 real 0m25.987s 00:03:45.981 user 0m7.650s 00:03:45.981 sys 0m14.489s 00:03:45.981 15:04:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:45.981 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:45.981 ************************************ 00:03:45.981 END TEST acl 00:03:45.981 ************************************ 00:03:45.981 15:04:49 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/hugepages.sh 00:03:45.981 15:04:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:45.981 15:04:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:45.981 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:45.981 ************************************ 00:03:45.981 START TEST hugepages 00:03:45.981 ************************************ 00:03:45.981 15:04:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/hugepages.sh 00:03:45.981 * Looking for test storage... 00:03:45.981 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:03:45.981 15:04:49 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:45.981 15:04:49 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:45.981 15:04:49 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:45.981 15:04:49 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:45.981 15:04:49 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:45.981 15:04:49 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:45.981 15:04:49 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:45.981 15:04:49 -- setup/common.sh@18 -- # local node= 00:03:45.981 15:04:49 -- setup/common.sh@19 -- # local var val 00:03:45.981 15:04:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:45.981 15:04:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:45.981 15:04:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:45.981 15:04:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:45.981 15:04:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:45.981 15:04:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 75747944 kB' 'MemAvailable: 79238972 kB' 'Buffers: 12988 kB' 'Cached: 9328956 kB' 'SwapCached: 0 kB' 'Active: 6509068 kB' 'Inactive: 3498508 kB' 'Active(anon): 5952124 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 669456 kB' 'Mapped: 162416 kB' 'Shmem: 5286492 kB' 'KReclaimable: 178472 kB' 'Slab: 511072 kB' 'SReclaimable: 178472 kB' 'SUnreclaim: 332600 kB' 'KernelStack: 15840 kB' 'PageTables: 8692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52443312 kB' 'Committed_AS: 7461416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210392 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.981 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.981 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # continue 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:45.982 15:04:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:45.982 15:04:49 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:45.982 15:04:49 -- setup/common.sh@33 -- # echo 2048 00:03:45.982 15:04:49 -- setup/common.sh@33 -- # return 0 00:03:45.982 15:04:49 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:45.982 15:04:49 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:45.982 15:04:49 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:45.982 15:04:49 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:45.982 15:04:49 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:45.982 15:04:49 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:45.982 15:04:49 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:45.982 15:04:49 -- setup/hugepages.sh@207 -- # get_nodes 00:03:45.982 15:04:49 -- setup/hugepages.sh@27 -- # local node 00:03:45.982 15:04:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:45.982 15:04:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:45.982 15:04:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:45.982 15:04:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:45.982 15:04:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:45.982 15:04:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:45.982 15:04:49 -- setup/hugepages.sh@208 -- # clear_hp 00:03:45.982 15:04:49 -- setup/hugepages.sh@37 -- # local node hp 00:03:45.982 15:04:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:45.982 15:04:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:45.983 15:04:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:45.983 15:04:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:45.983 15:04:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:45.983 15:04:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:45.983 15:04:49 -- setup/hugepages.sh@41 -- # echo 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:45.983 15:04:49 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:45.983 15:04:49 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:45.983 15:04:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:45.983 15:04:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:45.983 15:04:49 -- common/autotest_common.sh@10 -- # set +x 00:03:45.983 ************************************ 00:03:45.983 START TEST default_setup 00:03:45.983 ************************************ 00:03:45.983 15:04:49 -- common/autotest_common.sh@1111 -- # default_setup 00:03:45.983 15:04:49 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:45.983 15:04:49 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:45.983 15:04:49 -- setup/hugepages.sh@51 -- # shift 00:03:45.983 15:04:49 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:45.983 15:04:49 -- setup/hugepages.sh@52 -- # local node_ids 00:03:45.983 15:04:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:45.983 15:04:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:45.983 15:04:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:45.983 15:04:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:45.983 15:04:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:45.983 15:04:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:45.983 15:04:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:45.983 15:04:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:45.983 15:04:49 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:45.983 15:04:49 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:45.983 15:04:49 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:45.983 15:04:49 -- setup/hugepages.sh@73 -- # return 0 00:03:45.983 15:04:49 -- setup/hugepages.sh@137 -- # setup output 00:03:45.983 15:04:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.983 15:04:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:49.279 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.279 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.279 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.279 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.279 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.540 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:52.891 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:52.891 15:04:56 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:52.891 15:04:56 -- setup/hugepages.sh@89 -- # local node 00:03:52.891 15:04:56 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:52.891 15:04:56 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:52.891 15:04:56 -- setup/hugepages.sh@92 -- # local surp 00:03:52.891 15:04:56 -- setup/hugepages.sh@93 -- # local resv 00:03:52.891 15:04:56 -- setup/hugepages.sh@94 -- # local anon 00:03:52.891 15:04:56 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:52.891 15:04:56 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:52.891 15:04:56 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:52.891 15:04:56 -- setup/common.sh@18 -- # local node= 00:03:52.891 15:04:56 -- setup/common.sh@19 -- # local var val 00:03:52.891 15:04:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:52.891 15:04:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:52.891 15:04:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:52.891 15:04:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:52.891 15:04:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:52.891 15:04:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77889340 kB' 'MemAvailable: 81380100 kB' 'Buffers: 12988 kB' 'Cached: 9329076 kB' 'SwapCached: 0 kB' 'Active: 6516656 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959712 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676532 kB' 'Mapped: 162484 kB' 'Shmem: 5286612 kB' 'KReclaimable: 177936 kB' 'Slab: 508956 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331020 kB' 'KernelStack: 16032 kB' 'PageTables: 8632 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7473520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210328 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.891 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.891 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:52.892 15:04:56 -- setup/common.sh@33 -- # echo 0 00:03:52.892 15:04:56 -- setup/common.sh@33 -- # return 0 00:03:52.892 15:04:56 -- setup/hugepages.sh@97 -- # anon=0 00:03:52.892 15:04:56 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:52.892 15:04:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:52.892 15:04:56 -- setup/common.sh@18 -- # local node= 00:03:52.892 15:04:56 -- setup/common.sh@19 -- # local var val 00:03:52.892 15:04:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:52.892 15:04:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:52.892 15:04:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:52.892 15:04:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:52.892 15:04:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:52.892 15:04:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77892556 kB' 'MemAvailable: 81383316 kB' 'Buffers: 12988 kB' 'Cached: 9329076 kB' 'SwapCached: 0 kB' 'Active: 6516980 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960036 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676856 kB' 'Mapped: 162384 kB' 'Shmem: 5286612 kB' 'KReclaimable: 177936 kB' 'Slab: 509008 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331072 kB' 'KernelStack: 16224 kB' 'PageTables: 9452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7473532 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210312 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.892 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.892 15:04:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.893 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.893 15:04:56 -- setup/common.sh@33 -- # echo 0 00:03:52.893 15:04:56 -- setup/common.sh@33 -- # return 0 00:03:52.893 15:04:56 -- setup/hugepages.sh@99 -- # surp=0 00:03:52.893 15:04:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:52.893 15:04:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:52.893 15:04:56 -- setup/common.sh@18 -- # local node= 00:03:52.893 15:04:56 -- setup/common.sh@19 -- # local var val 00:03:52.893 15:04:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:52.893 15:04:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:52.893 15:04:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:52.893 15:04:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:52.893 15:04:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:52.893 15:04:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:52.893 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77894476 kB' 'MemAvailable: 81385236 kB' 'Buffers: 12988 kB' 'Cached: 9329088 kB' 'SwapCached: 0 kB' 'Active: 6517576 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960632 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 677436 kB' 'Mapped: 162384 kB' 'Shmem: 5286624 kB' 'KReclaimable: 177936 kB' 'Slab: 509008 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331072 kB' 'KernelStack: 16224 kB' 'PageTables: 9696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7473544 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210360 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.894 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.894 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:52.895 15:04:56 -- setup/common.sh@33 -- # echo 0 00:03:52.895 15:04:56 -- setup/common.sh@33 -- # return 0 00:03:52.895 15:04:56 -- setup/hugepages.sh@100 -- # resv=0 00:03:52.895 15:04:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:52.895 nr_hugepages=1024 00:03:52.895 15:04:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:52.895 resv_hugepages=0 00:03:52.895 15:04:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:52.895 surplus_hugepages=0 00:03:52.895 15:04:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:52.895 anon_hugepages=0 00:03:52.895 15:04:56 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:52.895 15:04:56 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:52.895 15:04:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:52.895 15:04:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:52.895 15:04:56 -- setup/common.sh@18 -- # local node= 00:03:52.895 15:04:56 -- setup/common.sh@19 -- # local var val 00:03:52.895 15:04:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:52.895 15:04:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:52.895 15:04:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:52.895 15:04:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:52.895 15:04:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:52.895 15:04:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77894288 kB' 'MemAvailable: 81385048 kB' 'Buffers: 12988 kB' 'Cached: 9329104 kB' 'SwapCached: 0 kB' 'Active: 6517708 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960764 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 677556 kB' 'Mapped: 162384 kB' 'Shmem: 5286640 kB' 'KReclaimable: 177936 kB' 'Slab: 508968 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331032 kB' 'KernelStack: 16192 kB' 'PageTables: 9836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7473560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210424 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.895 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.895 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.896 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.896 15:04:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:52.897 15:04:56 -- setup/common.sh@33 -- # echo 1024 00:03:52.897 15:04:56 -- setup/common.sh@33 -- # return 0 00:03:52.897 15:04:56 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:52.897 15:04:56 -- setup/hugepages.sh@112 -- # get_nodes 00:03:52.897 15:04:56 -- setup/hugepages.sh@27 -- # local node 00:03:52.897 15:04:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:52.897 15:04:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:52.897 15:04:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:52.897 15:04:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:52.897 15:04:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:52.897 15:04:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:52.897 15:04:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:52.897 15:04:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:52.897 15:04:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:52.897 15:04:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:52.897 15:04:56 -- setup/common.sh@18 -- # local node=0 00:03:52.897 15:04:56 -- setup/common.sh@19 -- # local var val 00:03:52.897 15:04:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:52.897 15:04:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:52.897 15:04:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:52.897 15:04:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:52.897 15:04:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:52.897 15:04:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 42700768 kB' 'MemUsed: 5426364 kB' 'SwapCached: 0 kB' 'Active: 1401064 kB' 'Inactive: 182832 kB' 'Active(anon): 1021084 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352164 kB' 'Mapped: 57864 kB' 'AnonPages: 234928 kB' 'Shmem: 789352 kB' 'KernelStack: 9144 kB' 'PageTables: 6152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250224 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202168 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.897 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.897 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # continue 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:52.898 15:04:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:52.898 15:04:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:52.898 15:04:56 -- setup/common.sh@33 -- # echo 0 00:03:52.898 15:04:56 -- setup/common.sh@33 -- # return 0 00:03:52.898 15:04:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:52.898 15:04:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:52.898 15:04:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:52.898 15:04:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:52.898 15:04:56 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:52.898 node0=1024 expecting 1024 00:03:52.898 15:04:56 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:52.898 00:03:52.898 real 0m6.783s 00:03:52.898 user 0m1.447s 00:03:52.898 sys 0m2.350s 00:03:52.898 15:04:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:52.898 15:04:56 -- common/autotest_common.sh@10 -- # set +x 00:03:52.898 ************************************ 00:03:52.898 END TEST default_setup 00:03:52.898 ************************************ 00:03:52.898 15:04:56 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:52.898 15:04:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:52.898 15:04:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:52.898 15:04:56 -- common/autotest_common.sh@10 -- # set +x 00:03:53.159 ************************************ 00:03:53.159 START TEST per_node_1G_alloc 00:03:53.159 ************************************ 00:03:53.159 15:04:56 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:03:53.159 15:04:56 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:53.159 15:04:56 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:53.159 15:04:56 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:53.159 15:04:56 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:53.159 15:04:56 -- setup/hugepages.sh@51 -- # shift 00:03:53.159 15:04:56 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:53.159 15:04:56 -- setup/hugepages.sh@52 -- # local node_ids 00:03:53.159 15:04:56 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:53.159 15:04:56 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:53.159 15:04:56 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:53.159 15:04:56 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:53.159 15:04:56 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:53.159 15:04:56 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:53.159 15:04:56 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:53.159 15:04:56 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:53.159 15:04:56 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:53.159 15:04:56 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:53.159 15:04:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:53.159 15:04:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:53.159 15:04:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:53.159 15:04:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:53.159 15:04:56 -- setup/hugepages.sh@73 -- # return 0 00:03:53.159 15:04:56 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:53.159 15:04:56 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:53.159 15:04:56 -- setup/hugepages.sh@146 -- # setup output 00:03:53.159 15:04:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:53.159 15:04:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:55.698 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:55.699 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:55.699 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:55.699 15:04:59 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:55.699 15:04:59 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:55.699 15:04:59 -- setup/hugepages.sh@89 -- # local node 00:03:55.699 15:04:59 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:55.699 15:04:59 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:55.699 15:04:59 -- setup/hugepages.sh@92 -- # local surp 00:03:55.699 15:04:59 -- setup/hugepages.sh@93 -- # local resv 00:03:55.699 15:04:59 -- setup/hugepages.sh@94 -- # local anon 00:03:55.699 15:04:59 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:55.965 15:04:59 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:55.965 15:04:59 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:55.965 15:04:59 -- setup/common.sh@18 -- # local node= 00:03:55.965 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.965 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.965 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.965 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.965 15:04:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.965 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.965 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77894360 kB' 'MemAvailable: 81385120 kB' 'Buffers: 12988 kB' 'Cached: 9329176 kB' 'SwapCached: 0 kB' 'Active: 6515156 kB' 'Inactive: 3498508 kB' 'Active(anon): 5958212 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 674732 kB' 'Mapped: 161508 kB' 'Shmem: 5286712 kB' 'KReclaimable: 177936 kB' 'Slab: 509368 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331432 kB' 'KernelStack: 15840 kB' 'PageTables: 8392 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7459572 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210376 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.965 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.965 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:55.966 15:04:59 -- setup/common.sh@33 -- # echo 0 00:03:55.966 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.966 15:04:59 -- setup/hugepages.sh@97 -- # anon=0 00:03:55.966 15:04:59 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:55.966 15:04:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.966 15:04:59 -- setup/common.sh@18 -- # local node= 00:03:55.966 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.966 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.966 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.966 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.966 15:04:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.966 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.966 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77894480 kB' 'MemAvailable: 81385240 kB' 'Buffers: 12988 kB' 'Cached: 9329180 kB' 'SwapCached: 0 kB' 'Active: 6514856 kB' 'Inactive: 3498508 kB' 'Active(anon): 5957912 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 674432 kB' 'Mapped: 161420 kB' 'Shmem: 5286716 kB' 'KReclaimable: 177936 kB' 'Slab: 509368 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331432 kB' 'KernelStack: 15824 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7459584 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210344 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.966 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.966 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.967 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.967 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.967 15:04:59 -- setup/common.sh@33 -- # echo 0 00:03:55.967 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.967 15:04:59 -- setup/hugepages.sh@99 -- # surp=0 00:03:55.967 15:04:59 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:55.967 15:04:59 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:55.967 15:04:59 -- setup/common.sh@18 -- # local node= 00:03:55.967 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.967 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.967 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.967 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.967 15:04:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.967 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.967 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.968 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77893996 kB' 'MemAvailable: 81384756 kB' 'Buffers: 12988 kB' 'Cached: 9329188 kB' 'SwapCached: 0 kB' 'Active: 6515132 kB' 'Inactive: 3498508 kB' 'Active(anon): 5958188 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 674716 kB' 'Mapped: 161420 kB' 'Shmem: 5286724 kB' 'KReclaimable: 177936 kB' 'Slab: 509412 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331476 kB' 'KernelStack: 15824 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7459600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210344 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.968 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.968 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:55.969 15:04:59 -- setup/common.sh@33 -- # echo 0 00:03:55.969 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.969 15:04:59 -- setup/hugepages.sh@100 -- # resv=0 00:03:55.969 15:04:59 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:55.969 nr_hugepages=1024 00:03:55.969 15:04:59 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:55.969 resv_hugepages=0 00:03:55.969 15:04:59 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:55.969 surplus_hugepages=0 00:03:55.969 15:04:59 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:55.969 anon_hugepages=0 00:03:55.969 15:04:59 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.969 15:04:59 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:55.969 15:04:59 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:55.969 15:04:59 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:55.969 15:04:59 -- setup/common.sh@18 -- # local node= 00:03:55.969 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.969 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.969 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.969 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:55.969 15:04:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:55.969 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.969 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.969 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77894312 kB' 'MemAvailable: 81385072 kB' 'Buffers: 12988 kB' 'Cached: 9329216 kB' 'SwapCached: 0 kB' 'Active: 6514516 kB' 'Inactive: 3498508 kB' 'Active(anon): 5957572 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 674044 kB' 'Mapped: 161420 kB' 'Shmem: 5286752 kB' 'KReclaimable: 177936 kB' 'Slab: 509412 kB' 'SReclaimable: 177936 kB' 'SUnreclaim: 331476 kB' 'KernelStack: 15824 kB' 'PageTables: 8368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7459616 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210344 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.969 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.969 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.970 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.970 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:55.970 15:04:59 -- setup/common.sh@33 -- # echo 1024 00:03:55.970 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.970 15:04:59 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:55.970 15:04:59 -- setup/hugepages.sh@112 -- # get_nodes 00:03:55.970 15:04:59 -- setup/hugepages.sh@27 -- # local node 00:03:55.970 15:04:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.970 15:04:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.970 15:04:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:55.971 15:04:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:55.971 15:04:59 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:55.971 15:04:59 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:55.971 15:04:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.971 15:04:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.971 15:04:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:55.971 15:04:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.971 15:04:59 -- setup/common.sh@18 -- # local node=0 00:03:55.971 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.971 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.971 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.971 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:55.971 15:04:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:55.971 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.971 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.971 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 43757724 kB' 'MemUsed: 4369408 kB' 'SwapCached: 0 kB' 'Active: 1398164 kB' 'Inactive: 182832 kB' 'Active(anon): 1018184 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352204 kB' 'Mapped: 56892 kB' 'AnonPages: 231984 kB' 'Shmem: 789392 kB' 'KernelStack: 8792 kB' 'PageTables: 4644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250832 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202776 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.971 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.971 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@33 -- # echo 0 00:03:55.972 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.972 15:04:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.972 15:04:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:55.972 15:04:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:55.972 15:04:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:55.972 15:04:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:55.972 15:04:59 -- setup/common.sh@18 -- # local node=1 00:03:55.972 15:04:59 -- setup/common.sh@19 -- # local var val 00:03:55.972 15:04:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:55.972 15:04:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:55.972 15:04:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:55.972 15:04:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:55.972 15:04:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:55.972 15:04:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 44176588 kB' 'MemFree: 34136976 kB' 'MemUsed: 10039612 kB' 'SwapCached: 0 kB' 'Active: 5116716 kB' 'Inactive: 3315676 kB' 'Active(anon): 4939752 kB' 'Inactive(anon): 0 kB' 'Active(file): 176964 kB' 'Inactive(file): 3315676 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7990000 kB' 'Mapped: 104528 kB' 'AnonPages: 442420 kB' 'Shmem: 4497360 kB' 'KernelStack: 7032 kB' 'PageTables: 3724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 129880 kB' 'Slab: 258580 kB' 'SReclaimable: 129880 kB' 'SUnreclaim: 128700 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.972 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.972 15:04:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # continue 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:55.973 15:04:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:55.973 15:04:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:55.973 15:04:59 -- setup/common.sh@33 -- # echo 0 00:03:55.973 15:04:59 -- setup/common.sh@33 -- # return 0 00:03:55.973 15:04:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:55.973 15:04:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.973 15:04:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.973 15:04:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.973 15:04:59 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:55.973 node0=512 expecting 512 00:03:55.973 15:04:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:55.973 15:04:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:55.973 15:04:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:55.973 15:04:59 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:55.973 node1=512 expecting 512 00:03:55.973 15:04:59 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:55.973 00:03:55.973 real 0m2.940s 00:03:55.973 user 0m0.973s 00:03:55.973 sys 0m1.833s 00:03:55.973 15:04:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:55.973 15:04:59 -- common/autotest_common.sh@10 -- # set +x 00:03:55.973 ************************************ 00:03:55.973 END TEST per_node_1G_alloc 00:03:55.973 ************************************ 00:03:55.973 15:04:59 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:55.973 15:04:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:55.973 15:04:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:55.973 15:04:59 -- common/autotest_common.sh@10 -- # set +x 00:03:56.233 ************************************ 00:03:56.233 START TEST even_2G_alloc 00:03:56.233 ************************************ 00:03:56.233 15:04:59 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:03:56.233 15:04:59 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:56.233 15:04:59 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:56.233 15:04:59 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:56.233 15:04:59 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:56.233 15:04:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:56.233 15:04:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:56.233 15:04:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:56.233 15:04:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:56.233 15:04:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:56.233 15:04:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:56.233 15:04:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:56.233 15:04:59 -- setup/hugepages.sh@83 -- # : 512 00:03:56.233 15:04:59 -- setup/hugepages.sh@84 -- # : 1 00:03:56.233 15:04:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:56.233 15:04:59 -- setup/hugepages.sh@83 -- # : 0 00:03:56.233 15:04:59 -- setup/hugepages.sh@84 -- # : 0 00:03:56.233 15:04:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:56.233 15:04:59 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:56.233 15:04:59 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:56.233 15:04:59 -- setup/hugepages.sh@153 -- # setup output 00:03:56.233 15:04:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:56.233 15:04:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:03:59.531 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:59.531 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:59.531 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:59.531 15:05:03 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:59.531 15:05:03 -- setup/hugepages.sh@89 -- # local node 00:03:59.531 15:05:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:59.531 15:05:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:59.531 15:05:03 -- setup/hugepages.sh@92 -- # local surp 00:03:59.531 15:05:03 -- setup/hugepages.sh@93 -- # local resv 00:03:59.531 15:05:03 -- setup/hugepages.sh@94 -- # local anon 00:03:59.531 15:05:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:59.531 15:05:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:59.531 15:05:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:59.531 15:05:03 -- setup/common.sh@18 -- # local node= 00:03:59.531 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.531 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.531 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.531 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.531 15:05:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.531 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.531 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.531 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77901188 kB' 'MemAvailable: 81391940 kB' 'Buffers: 12988 kB' 'Cached: 9329288 kB' 'SwapCached: 0 kB' 'Active: 6517212 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960268 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676696 kB' 'Mapped: 161560 kB' 'Shmem: 5286824 kB' 'KReclaimable: 177920 kB' 'Slab: 509704 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331784 kB' 'KernelStack: 16016 kB' 'PageTables: 8708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7460260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210504 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.531 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.531 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.532 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.532 15:05:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.533 15:05:03 -- setup/common.sh@33 -- # echo 0 00:03:59.533 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.533 15:05:03 -- setup/hugepages.sh@97 -- # anon=0 00:03:59.533 15:05:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:59.533 15:05:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.533 15:05:03 -- setup/common.sh@18 -- # local node= 00:03:59.533 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.533 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.533 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.533 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.533 15:05:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.533 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.533 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77901400 kB' 'MemAvailable: 81392152 kB' 'Buffers: 12988 kB' 'Cached: 9329288 kB' 'SwapCached: 0 kB' 'Active: 6516196 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959252 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675660 kB' 'Mapped: 161464 kB' 'Shmem: 5286824 kB' 'KReclaimable: 177920 kB' 'Slab: 509616 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331696 kB' 'KernelStack: 15856 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7460272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210424 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.533 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.533 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.534 15:05:03 -- setup/common.sh@33 -- # echo 0 00:03:59.534 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.534 15:05:03 -- setup/hugepages.sh@99 -- # surp=0 00:03:59.534 15:05:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:59.534 15:05:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:59.534 15:05:03 -- setup/common.sh@18 -- # local node= 00:03:59.534 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.534 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.534 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.534 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.534 15:05:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.534 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.534 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77901756 kB' 'MemAvailable: 81392508 kB' 'Buffers: 12988 kB' 'Cached: 9329288 kB' 'SwapCached: 0 kB' 'Active: 6515924 kB' 'Inactive: 3498508 kB' 'Active(anon): 5958980 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675376 kB' 'Mapped: 161464 kB' 'Shmem: 5286824 kB' 'KReclaimable: 177920 kB' 'Slab: 509616 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331696 kB' 'KernelStack: 15856 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7460284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210424 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.534 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.534 15:05:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.535 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.535 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.536 15:05:03 -- setup/common.sh@33 -- # echo 0 00:03:59.536 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.536 15:05:03 -- setup/hugepages.sh@100 -- # resv=0 00:03:59.536 15:05:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:59.536 nr_hugepages=1024 00:03:59.536 15:05:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:59.536 resv_hugepages=0 00:03:59.536 15:05:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:59.536 surplus_hugepages=0 00:03:59.536 15:05:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:59.536 anon_hugepages=0 00:03:59.536 15:05:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:59.536 15:05:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:59.536 15:05:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:59.536 15:05:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:59.536 15:05:03 -- setup/common.sh@18 -- # local node= 00:03:59.536 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.536 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.536 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.536 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.536 15:05:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.536 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.536 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77901508 kB' 'MemAvailable: 81392260 kB' 'Buffers: 12988 kB' 'Cached: 9329332 kB' 'SwapCached: 0 kB' 'Active: 6515896 kB' 'Inactive: 3498508 kB' 'Active(anon): 5958952 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675308 kB' 'Mapped: 161464 kB' 'Shmem: 5286868 kB' 'KReclaimable: 177920 kB' 'Slab: 509616 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331696 kB' 'KernelStack: 15856 kB' 'PageTables: 8200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7460300 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210424 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.536 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.536 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.537 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.537 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.537 15:05:03 -- setup/common.sh@33 -- # echo 1024 00:03:59.537 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.537 15:05:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:59.537 15:05:03 -- setup/hugepages.sh@112 -- # get_nodes 00:03:59.537 15:05:03 -- setup/hugepages.sh@27 -- # local node 00:03:59.537 15:05:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.537 15:05:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:59.537 15:05:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.537 15:05:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:59.537 15:05:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:59.800 15:05:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:59.800 15:05:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:59.800 15:05:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:59.800 15:05:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:59.800 15:05:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.800 15:05:03 -- setup/common.sh@18 -- # local node=0 00:03:59.800 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.800 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.800 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.800 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:59.800 15:05:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:59.800 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.800 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 43763176 kB' 'MemUsed: 4363956 kB' 'SwapCached: 0 kB' 'Active: 1398100 kB' 'Inactive: 182832 kB' 'Active(anon): 1018120 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352292 kB' 'Mapped: 56912 kB' 'AnonPages: 231836 kB' 'Shmem: 789480 kB' 'KernelStack: 8792 kB' 'PageTables: 4416 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250576 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.800 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.800 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@33 -- # echo 0 00:03:59.801 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.801 15:05:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:59.801 15:05:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:59.801 15:05:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:59.801 15:05:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:59.801 15:05:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.801 15:05:03 -- setup/common.sh@18 -- # local node=1 00:03:59.801 15:05:03 -- setup/common.sh@19 -- # local var val 00:03:59.801 15:05:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.801 15:05:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.801 15:05:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:59.801 15:05:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:59.801 15:05:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.801 15:05:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 44176588 kB' 'MemFree: 34139676 kB' 'MemUsed: 10036912 kB' 'SwapCached: 0 kB' 'Active: 5117920 kB' 'Inactive: 3315676 kB' 'Active(anon): 4940956 kB' 'Inactive(anon): 0 kB' 'Active(file): 176964 kB' 'Inactive(file): 3315676 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7990028 kB' 'Mapped: 104552 kB' 'AnonPages: 443668 kB' 'Shmem: 4497388 kB' 'KernelStack: 7032 kB' 'PageTables: 3672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 129864 kB' 'Slab: 259040 kB' 'SReclaimable: 129864 kB' 'SUnreclaim: 129176 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.801 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.801 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # continue 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.802 15:05:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.802 15:05:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.802 15:05:03 -- setup/common.sh@33 -- # echo 0 00:03:59.802 15:05:03 -- setup/common.sh@33 -- # return 0 00:03:59.802 15:05:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:59.802 15:05:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:59.802 15:05:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:59.802 15:05:03 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:59.802 node0=512 expecting 512 00:03:59.802 15:05:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:59.802 15:05:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:59.802 15:05:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:59.802 15:05:03 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:59.802 node1=512 expecting 512 00:03:59.802 15:05:03 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:59.802 00:03:59.802 real 0m3.516s 00:03:59.802 user 0m1.387s 00:03:59.802 sys 0m2.221s 00:03:59.802 15:05:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:59.802 15:05:03 -- common/autotest_common.sh@10 -- # set +x 00:03:59.802 ************************************ 00:03:59.802 END TEST even_2G_alloc 00:03:59.802 ************************************ 00:03:59.802 15:05:03 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:59.802 15:05:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.802 15:05:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.802 15:05:03 -- common/autotest_common.sh@10 -- # set +x 00:03:59.802 ************************************ 00:03:59.802 START TEST odd_alloc 00:03:59.802 ************************************ 00:03:59.802 15:05:03 -- common/autotest_common.sh@1111 -- # odd_alloc 00:03:59.802 15:05:03 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:59.802 15:05:03 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:59.802 15:05:03 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:59.802 15:05:03 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:59.802 15:05:03 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:59.802 15:05:03 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.802 15:05:03 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:59.802 15:05:03 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.802 15:05:03 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.802 15:05:03 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.802 15:05:03 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.802 15:05:03 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:59.803 15:05:03 -- setup/hugepages.sh@83 -- # : 513 00:03:59.803 15:05:03 -- setup/hugepages.sh@84 -- # : 1 00:03:59.803 15:05:03 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.803 15:05:03 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:59.803 15:05:03 -- setup/hugepages.sh@83 -- # : 0 00:03:59.803 15:05:03 -- setup/hugepages.sh@84 -- # : 0 00:03:59.803 15:05:03 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:59.803 15:05:03 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:59.803 15:05:03 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:59.803 15:05:03 -- setup/hugepages.sh@160 -- # setup output 00:03:59.803 15:05:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.803 15:05:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:04:03.112 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:03.112 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:03.113 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:03.113 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:03.113 15:05:06 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:03.113 15:05:06 -- setup/hugepages.sh@89 -- # local node 00:04:03.113 15:05:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:03.113 15:05:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:03.113 15:05:06 -- setup/hugepages.sh@92 -- # local surp 00:04:03.113 15:05:06 -- setup/hugepages.sh@93 -- # local resv 00:04:03.113 15:05:06 -- setup/hugepages.sh@94 -- # local anon 00:04:03.113 15:05:06 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:03.113 15:05:06 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:03.113 15:05:06 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:03.113 15:05:06 -- setup/common.sh@18 -- # local node= 00:04:03.113 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.113 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.113 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.113 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.113 15:05:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.113 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.113 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77862976 kB' 'MemAvailable: 81353728 kB' 'Buffers: 12988 kB' 'Cached: 9329408 kB' 'SwapCached: 0 kB' 'Active: 6516296 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959352 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675588 kB' 'Mapped: 161504 kB' 'Shmem: 5286944 kB' 'KReclaimable: 177920 kB' 'Slab: 509816 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331896 kB' 'KernelStack: 15824 kB' 'PageTables: 8372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53490864 kB' 'Committed_AS: 7460764 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210536 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.113 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.113 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.114 15:05:06 -- setup/common.sh@33 -- # echo 0 00:04:03.114 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.114 15:05:06 -- setup/hugepages.sh@97 -- # anon=0 00:04:03.114 15:05:06 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:03.114 15:05:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.114 15:05:06 -- setup/common.sh@18 -- # local node= 00:04:03.114 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.114 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.114 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.114 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.114 15:05:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.114 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.114 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77863884 kB' 'MemAvailable: 81354636 kB' 'Buffers: 12988 kB' 'Cached: 9329408 kB' 'SwapCached: 0 kB' 'Active: 6516508 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959564 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675804 kB' 'Mapped: 161472 kB' 'Shmem: 5286944 kB' 'KReclaimable: 177920 kB' 'Slab: 509836 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331916 kB' 'KernelStack: 15824 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53490864 kB' 'Committed_AS: 7460776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210520 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.114 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.114 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.115 15:05:06 -- setup/common.sh@33 -- # echo 0 00:04:03.115 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.115 15:05:06 -- setup/hugepages.sh@99 -- # surp=0 00:04:03.115 15:05:06 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:03.115 15:05:06 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:03.115 15:05:06 -- setup/common.sh@18 -- # local node= 00:04:03.115 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.115 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.115 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.115 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.115 15:05:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.115 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.115 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.115 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77865112 kB' 'MemAvailable: 81355864 kB' 'Buffers: 12988 kB' 'Cached: 9329420 kB' 'SwapCached: 0 kB' 'Active: 6516516 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959572 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675804 kB' 'Mapped: 161472 kB' 'Shmem: 5286956 kB' 'KReclaimable: 177920 kB' 'Slab: 509836 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331916 kB' 'KernelStack: 15824 kB' 'PageTables: 8388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53490864 kB' 'Committed_AS: 7460788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210536 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.115 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.115 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.116 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.116 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.117 15:05:06 -- setup/common.sh@33 -- # echo 0 00:04:03.117 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.117 15:05:06 -- setup/hugepages.sh@100 -- # resv=0 00:04:03.117 15:05:06 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:03.117 nr_hugepages=1025 00:04:03.117 15:05:06 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:03.117 resv_hugepages=0 00:04:03.117 15:05:06 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:03.117 surplus_hugepages=0 00:04:03.117 15:05:06 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:03.117 anon_hugepages=0 00:04:03.117 15:05:06 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:03.117 15:05:06 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:03.117 15:05:06 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:03.117 15:05:06 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:03.117 15:05:06 -- setup/common.sh@18 -- # local node= 00:04:03.117 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.117 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.117 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.117 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.117 15:05:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.117 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.117 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77867332 kB' 'MemAvailable: 81358084 kB' 'Buffers: 12988 kB' 'Cached: 9329436 kB' 'SwapCached: 0 kB' 'Active: 6516636 kB' 'Inactive: 3498508 kB' 'Active(anon): 5959692 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 675964 kB' 'Mapped: 161472 kB' 'Shmem: 5286972 kB' 'KReclaimable: 177920 kB' 'Slab: 509836 kB' 'SReclaimable: 177920 kB' 'SUnreclaim: 331916 kB' 'KernelStack: 15824 kB' 'PageTables: 8424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53490864 kB' 'Committed_AS: 7460436 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210568 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.117 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.117 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.118 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.118 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.118 15:05:06 -- setup/common.sh@33 -- # echo 1025 00:04:03.118 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.118 15:05:06 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:03.118 15:05:06 -- setup/hugepages.sh@112 -- # get_nodes 00:04:03.118 15:05:06 -- setup/hugepages.sh@27 -- # local node 00:04:03.118 15:05:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.118 15:05:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:03.118 15:05:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.118 15:05:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:03.118 15:05:06 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:03.118 15:05:06 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:03.118 15:05:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.118 15:05:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.118 15:05:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:03.118 15:05:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.118 15:05:06 -- setup/common.sh@18 -- # local node=0 00:04:03.118 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.118 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.118 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.118 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:03.118 15:05:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:03.118 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.119 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 43743968 kB' 'MemUsed: 4383164 kB' 'SwapCached: 0 kB' 'Active: 1398408 kB' 'Inactive: 182832 kB' 'Active(anon): 1018428 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352372 kB' 'Mapped: 56896 kB' 'AnonPages: 232044 kB' 'Shmem: 789560 kB' 'KernelStack: 8792 kB' 'PageTables: 4664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250960 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202904 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.119 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.119 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.119 15:05:06 -- setup/common.sh@33 -- # echo 0 00:04:03.119 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.119 15:05:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.119 15:05:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.120 15:05:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.120 15:05:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:03.120 15:05:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.120 15:05:06 -- setup/common.sh@18 -- # local node=1 00:04:03.120 15:05:06 -- setup/common.sh@19 -- # local var val 00:04:03.120 15:05:06 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.120 15:05:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.120 15:05:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:03.120 15:05:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:03.120 15:05:06 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.120 15:05:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.120 15:05:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 44176588 kB' 'MemFree: 34123188 kB' 'MemUsed: 10053400 kB' 'SwapCached: 0 kB' 'Active: 5117992 kB' 'Inactive: 3315676 kB' 'Active(anon): 4941028 kB' 'Inactive(anon): 0 kB' 'Active(file): 176964 kB' 'Inactive(file): 3315676 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7990068 kB' 'Mapped: 104576 kB' 'AnonPages: 443688 kB' 'Shmem: 4497428 kB' 'KernelStack: 7000 kB' 'PageTables: 3612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 129864 kB' 'Slab: 258868 kB' 'SReclaimable: 129864 kB' 'SUnreclaim: 129004 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.120 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.120 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.121 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.121 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.121 15:05:06 -- setup/common.sh@32 -- # continue 00:04:03.121 15:05:06 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.121 15:05:06 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.121 15:05:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.121 15:05:06 -- setup/common.sh@33 -- # echo 0 00:04:03.121 15:05:06 -- setup/common.sh@33 -- # return 0 00:04:03.121 15:05:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.121 15:05:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.121 15:05:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.121 15:05:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.121 15:05:06 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:03.121 node0=512 expecting 513 00:04:03.121 15:05:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.121 15:05:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.121 15:05:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.121 15:05:06 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:03.121 node1=513 expecting 512 00:04:03.121 15:05:06 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:03.121 00:04:03.121 real 0m3.176s 00:04:03.121 user 0m1.173s 00:04:03.121 sys 0m2.011s 00:04:03.121 15:05:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:03.121 15:05:06 -- common/autotest_common.sh@10 -- # set +x 00:04:03.121 ************************************ 00:04:03.121 END TEST odd_alloc 00:04:03.121 ************************************ 00:04:03.121 15:05:06 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:03.121 15:05:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.121 15:05:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.121 15:05:06 -- common/autotest_common.sh@10 -- # set +x 00:04:03.381 ************************************ 00:04:03.381 START TEST custom_alloc 00:04:03.381 ************************************ 00:04:03.381 15:05:07 -- common/autotest_common.sh@1111 -- # custom_alloc 00:04:03.381 15:05:07 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:03.381 15:05:07 -- setup/hugepages.sh@169 -- # local node 00:04:03.381 15:05:07 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:03.381 15:05:07 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:03.381 15:05:07 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:03.381 15:05:07 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:03.381 15:05:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:03.381 15:05:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:03.381 15:05:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:03.381 15:05:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:03.381 15:05:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.381 15:05:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:03.381 15:05:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.381 15:05:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.381 15:05:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.381 15:05:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:03.381 15:05:07 -- setup/hugepages.sh@83 -- # : 256 00:04:03.381 15:05:07 -- setup/hugepages.sh@84 -- # : 1 00:04:03.381 15:05:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:03.381 15:05:07 -- setup/hugepages.sh@83 -- # : 0 00:04:03.381 15:05:07 -- setup/hugepages.sh@84 -- # : 0 00:04:03.381 15:05:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:03.381 15:05:07 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:03.381 15:05:07 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:03.381 15:05:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:03.381 15:05:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:03.382 15:05:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:03.382 15:05:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:03.382 15:05:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.382 15:05:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:03.382 15:05:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.382 15:05:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.382 15:05:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.382 15:05:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:03.382 15:05:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:03.382 15:05:07 -- setup/hugepages.sh@78 -- # return 0 00:04:03.382 15:05:07 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:03.382 15:05:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:03.382 15:05:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:03.382 15:05:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:03.382 15:05:07 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:03.382 15:05:07 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:03.382 15:05:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:03.382 15:05:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.382 15:05:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:03.382 15:05:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.382 15:05:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.382 15:05:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.382 15:05:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:03.382 15:05:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:03.382 15:05:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:03.382 15:05:07 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:03.382 15:05:07 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:03.382 15:05:07 -- setup/hugepages.sh@78 -- # return 0 00:04:03.382 15:05:07 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:03.382 15:05:07 -- setup/hugepages.sh@187 -- # setup output 00:04:03.382 15:05:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.382 15:05:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:04:06.684 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:06.684 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.684 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.684 15:05:10 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:06.684 15:05:10 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:06.684 15:05:10 -- setup/hugepages.sh@89 -- # local node 00:04:06.684 15:05:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:06.684 15:05:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:06.684 15:05:10 -- setup/hugepages.sh@92 -- # local surp 00:04:06.684 15:05:10 -- setup/hugepages.sh@93 -- # local resv 00:04:06.684 15:05:10 -- setup/hugepages.sh@94 -- # local anon 00:04:06.684 15:05:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:06.684 15:05:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:06.684 15:05:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:06.684 15:05:10 -- setup/common.sh@18 -- # local node= 00:04:06.684 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.684 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.684 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.684 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.684 15:05:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.684 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.684 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 76833876 kB' 'MemAvailable: 80324608 kB' 'Buffers: 12988 kB' 'Cached: 9329536 kB' 'SwapCached: 0 kB' 'Active: 6518232 kB' 'Inactive: 3498508 kB' 'Active(anon): 5961288 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 677740 kB' 'Mapped: 161616 kB' 'Shmem: 5287072 kB' 'KReclaimable: 177880 kB' 'Slab: 509384 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331504 kB' 'KernelStack: 15840 kB' 'PageTables: 8396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52967600 kB' 'Committed_AS: 7461408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210408 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.684 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.684 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:06.685 15:05:10 -- setup/common.sh@33 -- # echo 0 00:04:06.685 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.685 15:05:10 -- setup/hugepages.sh@97 -- # anon=0 00:04:06.685 15:05:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:06.685 15:05:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.685 15:05:10 -- setup/common.sh@18 -- # local node= 00:04:06.685 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.685 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.685 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.685 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.685 15:05:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.685 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.685 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 76834308 kB' 'MemAvailable: 80325040 kB' 'Buffers: 12988 kB' 'Cached: 9329536 kB' 'SwapCached: 0 kB' 'Active: 6517600 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960656 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 677112 kB' 'Mapped: 161492 kB' 'Shmem: 5287072 kB' 'KReclaimable: 177880 kB' 'Slab: 509316 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331436 kB' 'KernelStack: 15808 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52967600 kB' 'Committed_AS: 7461420 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210392 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.685 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.685 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.686 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.686 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.687 15:05:10 -- setup/common.sh@33 -- # echo 0 00:04:06.687 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.687 15:05:10 -- setup/hugepages.sh@99 -- # surp=0 00:04:06.687 15:05:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:06.687 15:05:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:06.687 15:05:10 -- setup/common.sh@18 -- # local node= 00:04:06.687 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.687 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.687 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.687 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.687 15:05:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.687 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.687 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 76834056 kB' 'MemAvailable: 80324788 kB' 'Buffers: 12988 kB' 'Cached: 9329548 kB' 'SwapCached: 0 kB' 'Active: 6517452 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960508 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676936 kB' 'Mapped: 161492 kB' 'Shmem: 5287084 kB' 'KReclaimable: 177880 kB' 'Slab: 509316 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331436 kB' 'KernelStack: 15808 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52967600 kB' 'Committed_AS: 7461432 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210392 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.687 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.687 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:06.688 15:05:10 -- setup/common.sh@33 -- # echo 0 00:04:06.688 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.688 15:05:10 -- setup/hugepages.sh@100 -- # resv=0 00:04:06.688 15:05:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:06.688 nr_hugepages=1536 00:04:06.688 15:05:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:06.688 resv_hugepages=0 00:04:06.688 15:05:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:06.688 surplus_hugepages=0 00:04:06.688 15:05:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:06.688 anon_hugepages=0 00:04:06.688 15:05:10 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:06.688 15:05:10 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:06.688 15:05:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:06.688 15:05:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:06.688 15:05:10 -- setup/common.sh@18 -- # local node= 00:04:06.688 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.688 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.688 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.688 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:06.688 15:05:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:06.688 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.688 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 76834376 kB' 'MemAvailable: 80325108 kB' 'Buffers: 12988 kB' 'Cached: 9329564 kB' 'SwapCached: 0 kB' 'Active: 6517276 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960332 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676744 kB' 'Mapped: 161492 kB' 'Shmem: 5287100 kB' 'KReclaimable: 177880 kB' 'Slab: 509316 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331436 kB' 'KernelStack: 15808 kB' 'PageTables: 8328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52967600 kB' 'Committed_AS: 7461448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210392 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.688 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.688 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.689 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.689 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:06.690 15:05:10 -- setup/common.sh@33 -- # echo 1536 00:04:06.690 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.690 15:05:10 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:06.690 15:05:10 -- setup/hugepages.sh@112 -- # get_nodes 00:04:06.690 15:05:10 -- setup/hugepages.sh@27 -- # local node 00:04:06.690 15:05:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.690 15:05:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:06.690 15:05:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:06.690 15:05:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:06.690 15:05:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:06.690 15:05:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:06.690 15:05:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.690 15:05:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.690 15:05:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:06.690 15:05:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.690 15:05:10 -- setup/common.sh@18 -- # local node=0 00:04:06.690 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.690 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.690 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.690 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:06.690 15:05:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:06.690 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.690 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 43759732 kB' 'MemUsed: 4367400 kB' 'SwapCached: 0 kB' 'Active: 1396756 kB' 'Inactive: 182832 kB' 'Active(anon): 1016776 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352456 kB' 'Mapped: 56896 kB' 'AnonPages: 230380 kB' 'Shmem: 789644 kB' 'KernelStack: 8792 kB' 'PageTables: 4528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250684 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202628 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.690 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.690 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@33 -- # echo 0 00:04:06.691 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.691 15:05:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.691 15:05:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:06.691 15:05:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:06.691 15:05:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:06.691 15:05:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:06.691 15:05:10 -- setup/common.sh@18 -- # local node=1 00:04:06.691 15:05:10 -- setup/common.sh@19 -- # local var val 00:04:06.691 15:05:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:06.691 15:05:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:06.691 15:05:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:06.691 15:05:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:06.691 15:05:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:06.691 15:05:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 44176588 kB' 'MemFree: 33074644 kB' 'MemUsed: 11101944 kB' 'SwapCached: 0 kB' 'Active: 5120588 kB' 'Inactive: 3315676 kB' 'Active(anon): 4943624 kB' 'Inactive(anon): 0 kB' 'Active(file): 176964 kB' 'Inactive(file): 3315676 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7990108 kB' 'Mapped: 104596 kB' 'AnonPages: 446412 kB' 'Shmem: 4497468 kB' 'KernelStack: 7032 kB' 'PageTables: 3856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 129824 kB' 'Slab: 258632 kB' 'SReclaimable: 129824 kB' 'SUnreclaim: 128808 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.691 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.691 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.954 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.954 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # continue 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:06.955 15:05:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:06.955 15:05:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:06.955 15:05:10 -- setup/common.sh@33 -- # echo 0 00:04:06.955 15:05:10 -- setup/common.sh@33 -- # return 0 00:04:06.955 15:05:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:06.955 15:05:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.955 15:05:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.955 15:05:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.955 15:05:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:06.955 node0=512 expecting 512 00:04:06.955 15:05:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:06.955 15:05:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:06.955 15:05:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:06.955 15:05:10 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:06.955 node1=1024 expecting 1024 00:04:06.955 15:05:10 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:06.955 00:04:06.955 real 0m3.551s 00:04:06.955 user 0m1.306s 00:04:06.955 sys 0m2.301s 00:04:06.955 15:05:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:06.955 15:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:06.955 ************************************ 00:04:06.955 END TEST custom_alloc 00:04:06.955 ************************************ 00:04:06.955 15:05:10 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:06.955 15:05:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.955 15:05:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.955 15:05:10 -- common/autotest_common.sh@10 -- # set +x 00:04:06.955 ************************************ 00:04:06.955 START TEST no_shrink_alloc 00:04:06.955 ************************************ 00:04:06.955 15:05:10 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:04:06.955 15:05:10 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:06.955 15:05:10 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:06.955 15:05:10 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:06.955 15:05:10 -- setup/hugepages.sh@51 -- # shift 00:04:06.955 15:05:10 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:06.955 15:05:10 -- setup/hugepages.sh@52 -- # local node_ids 00:04:06.955 15:05:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:06.955 15:05:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:06.955 15:05:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:06.955 15:05:10 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:06.955 15:05:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:06.955 15:05:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:06.955 15:05:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:06.955 15:05:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:06.955 15:05:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:06.955 15:05:10 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:06.955 15:05:10 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:06.955 15:05:10 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:06.955 15:05:10 -- setup/hugepages.sh@73 -- # return 0 00:04:06.955 15:05:10 -- setup/hugepages.sh@198 -- # setup output 00:04:06.955 15:05:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:06.955 15:05:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:04:10.255 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:10.255 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:10.255 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:10.255 15:05:14 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:10.255 15:05:14 -- setup/hugepages.sh@89 -- # local node 00:04:10.255 15:05:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:10.255 15:05:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:10.255 15:05:14 -- setup/hugepages.sh@92 -- # local surp 00:04:10.255 15:05:14 -- setup/hugepages.sh@93 -- # local resv 00:04:10.255 15:05:14 -- setup/hugepages.sh@94 -- # local anon 00:04:10.255 15:05:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:10.255 15:05:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:10.255 15:05:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:10.255 15:05:14 -- setup/common.sh@18 -- # local node= 00:04:10.255 15:05:14 -- setup/common.sh@19 -- # local var val 00:04:10.255 15:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.255 15:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.255 15:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.255 15:05:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.255 15:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.255 15:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77761556 kB' 'MemAvailable: 81252288 kB' 'Buffers: 12988 kB' 'Cached: 9329648 kB' 'SwapCached: 0 kB' 'Active: 6517640 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960696 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676768 kB' 'Mapped: 161568 kB' 'Shmem: 5287184 kB' 'KReclaimable: 177880 kB' 'Slab: 508836 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 330956 kB' 'KernelStack: 15792 kB' 'PageTables: 8244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7461468 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210472 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.256 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.256 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:10.257 15:05:14 -- setup/common.sh@33 -- # echo 0 00:04:10.257 15:05:14 -- setup/common.sh@33 -- # return 0 00:04:10.257 15:05:14 -- setup/hugepages.sh@97 -- # anon=0 00:04:10.257 15:05:14 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:10.257 15:05:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:10.257 15:05:14 -- setup/common.sh@18 -- # local node= 00:04:10.257 15:05:14 -- setup/common.sh@19 -- # local var val 00:04:10.257 15:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.257 15:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.257 15:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.257 15:05:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.257 15:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.257 15:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77761008 kB' 'MemAvailable: 81251740 kB' 'Buffers: 12988 kB' 'Cached: 9329648 kB' 'SwapCached: 0 kB' 'Active: 6517348 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960404 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676488 kB' 'Mapped: 161524 kB' 'Shmem: 5287184 kB' 'KReclaimable: 177880 kB' 'Slab: 508892 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331012 kB' 'KernelStack: 15808 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7461480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210456 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.257 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.257 15:05:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.258 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.258 15:05:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.521 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.521 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.522 15:05:14 -- setup/common.sh@33 -- # echo 0 00:04:10.522 15:05:14 -- setup/common.sh@33 -- # return 0 00:04:10.522 15:05:14 -- setup/hugepages.sh@99 -- # surp=0 00:04:10.522 15:05:14 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:10.522 15:05:14 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:10.522 15:05:14 -- setup/common.sh@18 -- # local node= 00:04:10.522 15:05:14 -- setup/common.sh@19 -- # local var val 00:04:10.522 15:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.522 15:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.522 15:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.522 15:05:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.522 15:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.522 15:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77761008 kB' 'MemAvailable: 81251740 kB' 'Buffers: 12988 kB' 'Cached: 9329648 kB' 'SwapCached: 0 kB' 'Active: 6517324 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960380 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676488 kB' 'Mapped: 161524 kB' 'Shmem: 5287184 kB' 'KReclaimable: 177880 kB' 'Slab: 508892 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331012 kB' 'KernelStack: 15808 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7461492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210456 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.522 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.522 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:10.523 15:05:14 -- setup/common.sh@33 -- # echo 0 00:04:10.523 15:05:14 -- setup/common.sh@33 -- # return 0 00:04:10.523 15:05:14 -- setup/hugepages.sh@100 -- # resv=0 00:04:10.523 15:05:14 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:10.523 nr_hugepages=1024 00:04:10.523 15:05:14 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:10.523 resv_hugepages=0 00:04:10.523 15:05:14 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:10.523 surplus_hugepages=0 00:04:10.523 15:05:14 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:10.523 anon_hugepages=0 00:04:10.523 15:05:14 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:10.523 15:05:14 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:10.523 15:05:14 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:10.523 15:05:14 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:10.523 15:05:14 -- setup/common.sh@18 -- # local node= 00:04:10.523 15:05:14 -- setup/common.sh@19 -- # local var val 00:04:10.523 15:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.523 15:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.523 15:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:10.523 15:05:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:10.523 15:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.523 15:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77761008 kB' 'MemAvailable: 81251740 kB' 'Buffers: 12988 kB' 'Cached: 9329648 kB' 'SwapCached: 0 kB' 'Active: 6517324 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960380 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676488 kB' 'Mapped: 161524 kB' 'Shmem: 5287184 kB' 'KReclaimable: 177880 kB' 'Slab: 508892 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331012 kB' 'KernelStack: 15808 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7461508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210456 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.523 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.523 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:10.524 15:05:14 -- setup/common.sh@33 -- # echo 1024 00:04:10.524 15:05:14 -- setup/common.sh@33 -- # return 0 00:04:10.524 15:05:14 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:10.524 15:05:14 -- setup/hugepages.sh@112 -- # get_nodes 00:04:10.524 15:05:14 -- setup/hugepages.sh@27 -- # local node 00:04:10.524 15:05:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:10.524 15:05:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:10.524 15:05:14 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:10.524 15:05:14 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:10.524 15:05:14 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:10.524 15:05:14 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:10.524 15:05:14 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:10.524 15:05:14 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:10.524 15:05:14 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:10.524 15:05:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:10.524 15:05:14 -- setup/common.sh@18 -- # local node=0 00:04:10.524 15:05:14 -- setup/common.sh@19 -- # local var val 00:04:10.524 15:05:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:10.524 15:05:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:10.524 15:05:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:10.524 15:05:14 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:10.524 15:05:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:10.524 15:05:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:10.524 15:05:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 42700080 kB' 'MemUsed: 5427052 kB' 'SwapCached: 0 kB' 'Active: 1395916 kB' 'Inactive: 182832 kB' 'Active(anon): 1015936 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352496 kB' 'Mapped: 56904 kB' 'AnonPages: 229388 kB' 'Shmem: 789684 kB' 'KernelStack: 8776 kB' 'PageTables: 4484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250300 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202244 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.524 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.524 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # continue 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:10.525 15:05:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:10.525 15:05:14 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:10.525 15:05:14 -- setup/common.sh@33 -- # echo 0 00:04:10.525 15:05:14 -- setup/common.sh@33 -- # return 0 00:04:10.525 15:05:14 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:10.525 15:05:14 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:10.525 15:05:14 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:10.525 15:05:14 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:10.525 15:05:14 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:10.525 node0=1024 expecting 1024 00:04:10.525 15:05:14 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:10.525 15:05:14 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:10.525 15:05:14 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:10.525 15:05:14 -- setup/hugepages.sh@202 -- # setup output 00:04:10.525 15:05:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:10.525 15:05:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:04:13.828 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:13.828 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:13.828 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:13.828 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:13.828 15:05:17 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:13.828 15:05:17 -- setup/hugepages.sh@89 -- # local node 00:04:13.828 15:05:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:13.828 15:05:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:13.828 15:05:17 -- setup/hugepages.sh@92 -- # local surp 00:04:13.828 15:05:17 -- setup/hugepages.sh@93 -- # local resv 00:04:13.828 15:05:17 -- setup/hugepages.sh@94 -- # local anon 00:04:13.828 15:05:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:13.828 15:05:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:13.828 15:05:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:13.828 15:05:17 -- setup/common.sh@18 -- # local node= 00:04:13.828 15:05:17 -- setup/common.sh@19 -- # local var val 00:04:13.828 15:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:13.828 15:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:13.828 15:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:13.828 15:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:13.828 15:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:13.828 15:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77770056 kB' 'MemAvailable: 81260788 kB' 'Buffers: 12988 kB' 'Cached: 9329744 kB' 'SwapCached: 0 kB' 'Active: 6518132 kB' 'Inactive: 3498508 kB' 'Active(anon): 5961188 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 677164 kB' 'Mapped: 161568 kB' 'Shmem: 5287280 kB' 'KReclaimable: 177880 kB' 'Slab: 509124 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331244 kB' 'KernelStack: 15808 kB' 'PageTables: 8332 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7462088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210472 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.828 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.828 15:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:13.829 15:05:17 -- setup/common.sh@33 -- # echo 0 00:04:13.829 15:05:17 -- setup/common.sh@33 -- # return 0 00:04:13.829 15:05:17 -- setup/hugepages.sh@97 -- # anon=0 00:04:13.829 15:05:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:13.829 15:05:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:13.829 15:05:17 -- setup/common.sh@18 -- # local node= 00:04:13.829 15:05:17 -- setup/common.sh@19 -- # local var val 00:04:13.829 15:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:13.829 15:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:13.829 15:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:13.829 15:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:13.829 15:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:13.829 15:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77770056 kB' 'MemAvailable: 81260788 kB' 'Buffers: 12988 kB' 'Cached: 9329744 kB' 'SwapCached: 0 kB' 'Active: 6517772 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960828 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676860 kB' 'Mapped: 161532 kB' 'Shmem: 5287280 kB' 'KReclaimable: 177880 kB' 'Slab: 509116 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331236 kB' 'KernelStack: 15808 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7462100 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210488 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.829 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.829 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.830 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.830 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.831 15:05:17 -- setup/common.sh@33 -- # echo 0 00:04:13.831 15:05:17 -- setup/common.sh@33 -- # return 0 00:04:13.831 15:05:17 -- setup/hugepages.sh@99 -- # surp=0 00:04:13.831 15:05:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:13.831 15:05:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:13.831 15:05:17 -- setup/common.sh@18 -- # local node= 00:04:13.831 15:05:17 -- setup/common.sh@19 -- # local var val 00:04:13.831 15:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:13.831 15:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:13.831 15:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:13.831 15:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:13.831 15:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:13.831 15:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77770056 kB' 'MemAvailable: 81260788 kB' 'Buffers: 12988 kB' 'Cached: 9329744 kB' 'SwapCached: 0 kB' 'Active: 6517812 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960868 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676896 kB' 'Mapped: 161532 kB' 'Shmem: 5287280 kB' 'KReclaimable: 177880 kB' 'Slab: 509116 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331236 kB' 'KernelStack: 15824 kB' 'PageTables: 8400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7462112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210488 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.831 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.831 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:13.832 15:05:17 -- setup/common.sh@33 -- # echo 0 00:04:13.832 15:05:17 -- setup/common.sh@33 -- # return 0 00:04:13.832 15:05:17 -- setup/hugepages.sh@100 -- # resv=0 00:04:13.832 15:05:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:13.832 nr_hugepages=1024 00:04:13.832 15:05:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:13.832 resv_hugepages=0 00:04:13.832 15:05:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:13.832 surplus_hugepages=0 00:04:13.832 15:05:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:13.832 anon_hugepages=0 00:04:13.832 15:05:17 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:13.832 15:05:17 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:13.832 15:05:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:13.832 15:05:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:13.832 15:05:17 -- setup/common.sh@18 -- # local node= 00:04:13.832 15:05:17 -- setup/common.sh@19 -- # local var val 00:04:13.832 15:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:13.832 15:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:13.832 15:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:13.832 15:05:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:13.832 15:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:13.832 15:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 92303720 kB' 'MemFree: 77771176 kB' 'MemAvailable: 81261908 kB' 'Buffers: 12988 kB' 'Cached: 9329772 kB' 'SwapCached: 0 kB' 'Active: 6517852 kB' 'Inactive: 3498508 kB' 'Active(anon): 5960908 kB' 'Inactive(anon): 0 kB' 'Active(file): 556944 kB' 'Inactive(file): 3498508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 676852 kB' 'Mapped: 161532 kB' 'Shmem: 5287308 kB' 'KReclaimable: 177880 kB' 'Slab: 509116 kB' 'SReclaimable: 177880 kB' 'SUnreclaim: 331236 kB' 'KernelStack: 15808 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53491888 kB' 'Committed_AS: 7462128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 210488 kB' 'VmallocChunk: 0 kB' 'Percpu: 50880 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 587124 kB' 'DirectMap2M: 11681792 kB' 'DirectMap1G: 89128960 kB' 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.832 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.832 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.833 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.833 15:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:13.834 15:05:17 -- setup/common.sh@33 -- # echo 1024 00:04:13.834 15:05:17 -- setup/common.sh@33 -- # return 0 00:04:13.834 15:05:17 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:13.834 15:05:17 -- setup/hugepages.sh@112 -- # get_nodes 00:04:13.834 15:05:17 -- setup/hugepages.sh@27 -- # local node 00:04:13.834 15:05:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:13.834 15:05:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:13.834 15:05:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:13.834 15:05:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:13.834 15:05:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:13.834 15:05:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:13.834 15:05:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:13.834 15:05:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:13.834 15:05:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:13.834 15:05:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:13.834 15:05:17 -- setup/common.sh@18 -- # local node=0 00:04:13.834 15:05:17 -- setup/common.sh@19 -- # local var val 00:04:13.834 15:05:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:13.834 15:05:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:13.834 15:05:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:13.834 15:05:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:13.834 15:05:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:13.834 15:05:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:13.834 15:05:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 48127132 kB' 'MemFree: 42700952 kB' 'MemUsed: 5426180 kB' 'SwapCached: 0 kB' 'Active: 1395344 kB' 'Inactive: 182832 kB' 'Active(anon): 1015364 kB' 'Inactive(anon): 0 kB' 'Active(file): 379980 kB' 'Inactive(file): 182832 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1352608 kB' 'Mapped: 56904 kB' 'AnonPages: 228676 kB' 'Shmem: 789796 kB' 'KernelStack: 8744 kB' 'PageTables: 4368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 48056 kB' 'Slab: 250568 kB' 'SReclaimable: 48056 kB' 'SUnreclaim: 202512 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.834 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.834 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # continue 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:13.835 15:05:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:13.835 15:05:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:13.835 15:05:17 -- setup/common.sh@33 -- # echo 0 00:04:13.835 15:05:17 -- setup/common.sh@33 -- # return 0 00:04:13.835 15:05:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:13.835 15:05:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:13.835 15:05:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:13.835 15:05:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:13.835 15:05:17 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:13.835 node0=1024 expecting 1024 00:04:13.835 15:05:17 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:13.835 00:04:13.835 real 0m6.760s 00:04:13.835 user 0m2.641s 00:04:13.835 sys 0m4.273s 00:04:13.835 15:05:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:13.835 15:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:13.835 ************************************ 00:04:13.835 END TEST no_shrink_alloc 00:04:13.835 ************************************ 00:04:13.835 15:05:17 -- setup/hugepages.sh@217 -- # clear_hp 00:04:13.835 15:05:17 -- setup/hugepages.sh@37 -- # local node hp 00:04:13.835 15:05:17 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:13.835 15:05:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:13.835 15:05:17 -- setup/hugepages.sh@41 -- # echo 0 00:04:13.835 15:05:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:13.835 15:05:17 -- setup/hugepages.sh@41 -- # echo 0 00:04:13.835 15:05:17 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:13.835 15:05:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:13.835 15:05:17 -- setup/hugepages.sh@41 -- # echo 0 00:04:13.835 15:05:17 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:13.835 15:05:17 -- setup/hugepages.sh@41 -- # echo 0 00:04:13.835 15:05:17 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:13.835 15:05:17 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:13.835 00:04:13.835 real 0m28.091s 00:04:13.835 user 0m9.433s 00:04:13.835 sys 0m15.744s 00:04:13.835 15:05:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:13.835 15:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:13.835 ************************************ 00:04:13.835 END TEST hugepages 00:04:13.835 ************************************ 00:04:13.835 15:05:17 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/driver.sh 00:04:13.835 15:05:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.835 15:05:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.835 15:05:17 -- common/autotest_common.sh@10 -- # set +x 00:04:14.095 ************************************ 00:04:14.095 START TEST driver 00:04:14.095 ************************************ 00:04:14.095 15:05:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/driver.sh 00:04:14.095 * Looking for test storage... 00:04:14.095 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:04:14.095 15:05:17 -- setup/driver.sh@68 -- # setup reset 00:04:14.095 15:05:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:14.095 15:05:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:04:19.380 15:05:22 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:19.380 15:05:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.380 15:05:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.380 15:05:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.380 ************************************ 00:04:19.380 START TEST guess_driver 00:04:19.380 ************************************ 00:04:19.380 15:05:22 -- common/autotest_common.sh@1111 -- # guess_driver 00:04:19.380 15:05:22 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:19.380 15:05:22 -- setup/driver.sh@47 -- # local fail=0 00:04:19.380 15:05:22 -- setup/driver.sh@49 -- # pick_driver 00:04:19.380 15:05:22 -- setup/driver.sh@36 -- # vfio 00:04:19.380 15:05:22 -- setup/driver.sh@21 -- # local iommu_grups 00:04:19.380 15:05:22 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:19.380 15:05:22 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:19.380 15:05:22 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:19.380 15:05:22 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:19.380 15:05:22 -- setup/driver.sh@29 -- # (( 216 > 0 )) 00:04:19.380 15:05:22 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:19.380 15:05:22 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:19.380 15:05:22 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:19.380 15:05:22 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:19.380 15:05:22 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:19.380 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:19.380 15:05:22 -- setup/driver.sh@30 -- # return 0 00:04:19.380 15:05:22 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:19.380 15:05:22 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:19.380 15:05:22 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:19.380 15:05:22 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:19.380 Looking for driver=vfio-pci 00:04:19.380 15:05:22 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:19.380 15:05:22 -- setup/driver.sh@45 -- # setup output config 00:04:19.380 15:05:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.380 15:05:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.931 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.931 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.931 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.932 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.932 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:21.932 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:21.932 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:21.932 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:22.191 15:05:25 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:22.191 15:05:25 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:22.191 15:05:25 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:25.488 15:05:28 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:25.488 15:05:28 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:25.488 15:05:28 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:25.488 15:05:29 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:25.488 15:05:29 -- setup/driver.sh@65 -- # setup reset 00:04:25.488 15:05:29 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:25.488 15:05:29 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.771 00:04:30.771 real 0m10.918s 00:04:30.771 user 0m2.387s 00:04:30.771 sys 0m4.712s 00:04:30.771 15:05:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:30.771 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:30.771 ************************************ 00:04:30.771 END TEST guess_driver 00:04:30.771 ************************************ 00:04:30.771 00:04:30.771 real 0m16.070s 00:04:30.771 user 0m3.880s 00:04:30.771 sys 0m7.613s 00:04:30.771 15:05:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:30.771 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:30.771 ************************************ 00:04:30.771 END TEST driver 00:04:30.771 ************************************ 00:04:30.771 15:05:33 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/devices.sh 00:04:30.771 15:05:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.771 15:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.771 15:05:33 -- common/autotest_common.sh@10 -- # set +x 00:04:30.771 ************************************ 00:04:30.771 START TEST devices 00:04:30.771 ************************************ 00:04:30.771 15:05:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/devices.sh 00:04:30.771 * Looking for test storage... 00:04:30.771 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup 00:04:30.771 15:05:34 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:30.771 15:05:34 -- setup/devices.sh@192 -- # setup reset 00:04:30.771 15:05:34 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:30.771 15:05:34 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:04:34.973 15:05:37 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:34.973 15:05:37 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:34.973 15:05:37 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:34.974 15:05:37 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:34.974 15:05:37 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:34.974 15:05:37 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:34.974 15:05:37 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:34.974 15:05:37 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:34.974 15:05:37 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:34.974 15:05:37 -- setup/devices.sh@196 -- # blocks=() 00:04:34.974 15:05:37 -- setup/devices.sh@196 -- # declare -a blocks 00:04:34.974 15:05:37 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:34.974 15:05:37 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:34.974 15:05:37 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:34.974 15:05:37 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:34.974 15:05:37 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:34.974 15:05:37 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:34.974 15:05:37 -- setup/devices.sh@202 -- # pci=0000:5e:00.0 00:04:34.974 15:05:37 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:04:34.974 15:05:37 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:34.974 15:05:37 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:04:34.974 15:05:37 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:34.974 No valid GPT data, bailing 00:04:34.974 15:05:38 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:34.974 15:05:38 -- scripts/common.sh@391 -- # pt= 00:04:34.974 15:05:38 -- scripts/common.sh@392 -- # return 1 00:04:34.974 15:05:38 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:34.974 15:05:38 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:34.974 15:05:38 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:34.974 15:05:38 -- setup/common.sh@80 -- # echo 4000787030016 00:04:34.974 15:05:38 -- setup/devices.sh@204 -- # (( 4000787030016 >= min_disk_size )) 00:04:34.974 15:05:38 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:34.974 15:05:38 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5e:00.0 00:04:34.974 15:05:38 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:34.974 15:05:38 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:34.974 15:05:38 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:34.974 15:05:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.974 15:05:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.974 15:05:38 -- common/autotest_common.sh@10 -- # set +x 00:04:34.974 ************************************ 00:04:34.974 START TEST nvme_mount 00:04:34.974 ************************************ 00:04:34.974 15:05:38 -- common/autotest_common.sh@1111 -- # nvme_mount 00:04:34.974 15:05:38 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:34.974 15:05:38 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:34.974 15:05:38 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:34.974 15:05:38 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:34.974 15:05:38 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:34.974 15:05:38 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:34.974 15:05:38 -- setup/common.sh@40 -- # local part_no=1 00:04:34.974 15:05:38 -- setup/common.sh@41 -- # local size=1073741824 00:04:34.974 15:05:38 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:34.974 15:05:38 -- setup/common.sh@44 -- # parts=() 00:04:34.974 15:05:38 -- setup/common.sh@44 -- # local parts 00:04:34.974 15:05:38 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:34.974 15:05:38 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:34.974 15:05:38 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:34.974 15:05:38 -- setup/common.sh@46 -- # (( part++ )) 00:04:34.974 15:05:38 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:34.974 15:05:38 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:34.974 15:05:38 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:34.974 15:05:38 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:35.544 Creating new GPT entries in memory. 00:04:35.544 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:35.544 other utilities. 00:04:35.544 15:05:39 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:35.544 15:05:39 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:35.544 15:05:39 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:35.544 15:05:39 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:35.544 15:05:39 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:36.484 Creating new GPT entries in memory. 00:04:36.484 The operation has completed successfully. 00:04:36.484 15:05:40 -- setup/common.sh@57 -- # (( part++ )) 00:04:36.484 15:05:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:36.484 15:05:40 -- setup/common.sh@62 -- # wait 472691 00:04:36.484 15:05:40 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.484 15:05:40 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:36.484 15:05:40 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.484 15:05:40 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:36.484 15:05:40 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:36.484 15:05:40 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.484 15:05:40 -- setup/devices.sh@105 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:36.484 15:05:40 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:36.484 15:05:40 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:36.484 15:05:40 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:36.484 15:05:40 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:36.484 15:05:40 -- setup/devices.sh@53 -- # local found=0 00:04:36.484 15:05:40 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:36.484 15:05:40 -- setup/devices.sh@56 -- # : 00:04:36.484 15:05:40 -- setup/devices.sh@59 -- # local pci status 00:04:36.484 15:05:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:36.484 15:05:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:36.484 15:05:40 -- setup/devices.sh@47 -- # setup output config 00:04:36.484 15:05:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:36.484 15:05:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:40.690 15:05:43 -- setup/devices.sh@63 -- # found=1 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.690 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.690 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:40.691 15:05:43 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:40.691 15:05:43 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:43 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.691 15:05:43 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.691 15:05:43 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:40.691 15:05:43 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:43 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:43 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:40.691 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:40.691 15:05:43 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:40.691 15:05:43 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:40.691 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:40.691 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:40.691 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:40.691 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:40.691 15:05:44 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:40.691 15:05:44 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:40.691 15:05:44 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:44 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:40.691 15:05:44 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:40.691 15:05:44 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:44 -- setup/devices.sh@116 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.691 15:05:44 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:40.691 15:05:44 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:40.691 15:05:44 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.691 15:05:44 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.691 15:05:44 -- setup/devices.sh@53 -- # local found=0 00:04:40.691 15:05:44 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.691 15:05:44 -- setup/devices.sh@56 -- # : 00:04:40.691 15:05:44 -- setup/devices.sh@59 -- # local pci status 00:04:40.691 15:05:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.691 15:05:44 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:40.691 15:05:44 -- setup/devices.sh@47 -- # setup output config 00:04:40.691 15:05:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.691 15:05:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:43.989 15:05:47 -- setup/devices.sh@63 -- # found=1 00:04:43.989 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.989 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.989 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.989 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.989 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.989 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:43.990 15:05:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:43.990 15:05:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.990 15:05:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:43.990 15:05:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:43.990 15:05:47 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.990 15:05:47 -- setup/devices.sh@125 -- # verify 0000:5e:00.0 data@nvme0n1 '' '' 00:04:43.990 15:05:47 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:43.990 15:05:47 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:43.990 15:05:47 -- setup/devices.sh@50 -- # local mount_point= 00:04:43.990 15:05:47 -- setup/devices.sh@51 -- # local test_file= 00:04:43.990 15:05:47 -- setup/devices.sh@53 -- # local found=0 00:04:43.990 15:05:47 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:43.990 15:05:47 -- setup/devices.sh@59 -- # local pci status 00:04:43.990 15:05:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.990 15:05:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:43.990 15:05:47 -- setup/devices.sh@47 -- # setup output config 00:04:43.990 15:05:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.990 15:05:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:48.191 15:05:51 -- setup/devices.sh@63 -- # found=1 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.191 15:05:51 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:48.191 15:05:51 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:48.191 15:05:51 -- setup/devices.sh@68 -- # return 0 00:04:48.191 15:05:51 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:48.191 15:05:51 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:48.191 15:05:51 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:48.191 15:05:51 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:48.191 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:48.191 00:04:48.191 real 0m13.233s 00:04:48.191 user 0m3.999s 00:04:48.191 sys 0m7.142s 00:04:48.191 15:05:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:48.191 15:05:51 -- common/autotest_common.sh@10 -- # set +x 00:04:48.191 ************************************ 00:04:48.191 END TEST nvme_mount 00:04:48.191 ************************************ 00:04:48.191 15:05:51 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:48.191 15:05:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.191 15:05:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.191 15:05:51 -- common/autotest_common.sh@10 -- # set +x 00:04:48.191 ************************************ 00:04:48.191 START TEST dm_mount 00:04:48.191 ************************************ 00:04:48.191 15:05:51 -- common/autotest_common.sh@1111 -- # dm_mount 00:04:48.191 15:05:51 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:48.191 15:05:51 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:48.191 15:05:51 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:48.191 15:05:51 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:48.191 15:05:51 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:48.191 15:05:51 -- setup/common.sh@40 -- # local part_no=2 00:04:48.191 15:05:51 -- setup/common.sh@41 -- # local size=1073741824 00:04:48.191 15:05:51 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:48.191 15:05:51 -- setup/common.sh@44 -- # parts=() 00:04:48.191 15:05:51 -- setup/common.sh@44 -- # local parts 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.191 15:05:51 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part++ )) 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.191 15:05:51 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part++ )) 00:04:48.191 15:05:51 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.191 15:05:51 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:48.191 15:05:51 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:48.191 15:05:51 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:48.758 Creating new GPT entries in memory. 00:04:48.758 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:48.758 other utilities. 00:04:48.758 15:05:52 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:48.758 15:05:52 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:48.758 15:05:52 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:48.758 15:05:52 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:48.758 15:05:52 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:50.139 Creating new GPT entries in memory. 00:04:50.139 The operation has completed successfully. 00:04:50.139 15:05:53 -- setup/common.sh@57 -- # (( part++ )) 00:04:50.140 15:05:53 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:50.140 15:05:53 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:50.140 15:05:53 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:50.140 15:05:53 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:51.079 The operation has completed successfully. 00:04:51.080 15:05:54 -- setup/common.sh@57 -- # (( part++ )) 00:04:51.080 15:05:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:51.080 15:05:54 -- setup/common.sh@62 -- # wait 477030 00:04:51.080 15:05:54 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:51.080 15:05:54 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:51.080 15:05:54 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.080 15:05:54 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:51.080 15:05:54 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:51.080 15:05:54 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.080 15:05:54 -- setup/devices.sh@161 -- # break 00:04:51.080 15:05:54 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.080 15:05:54 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:51.080 15:05:54 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:51.080 15:05:54 -- setup/devices.sh@166 -- # dm=dm-0 00:04:51.080 15:05:54 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:51.080 15:05:54 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:51.080 15:05:54 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:51.080 15:05:54 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount size= 00:04:51.080 15:05:54 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:51.080 15:05:54 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:51.080 15:05:54 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:51.080 15:05:54 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:51.080 15:05:54 -- setup/devices.sh@174 -- # verify 0000:5e:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.080 15:05:54 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:51.080 15:05:54 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:51.080 15:05:54 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:51.080 15:05:54 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:51.080 15:05:54 -- setup/devices.sh@53 -- # local found=0 00:04:51.080 15:05:54 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:51.080 15:05:54 -- setup/devices.sh@56 -- # : 00:04:51.080 15:05:54 -- setup/devices.sh@59 -- # local pci status 00:04:51.080 15:05:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.080 15:05:54 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:51.080 15:05:54 -- setup/devices.sh@47 -- # setup output config 00:04:51.080 15:05:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.080 15:05:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:55.281 15:05:58 -- setup/devices.sh@63 -- # found=1 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:55.281 15:05:58 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:55.281 15:05:58 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:55.281 15:05:58 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:55.281 15:05:58 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:55.281 15:05:58 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:55.281 15:05:58 -- setup/devices.sh@184 -- # verify 0000:5e:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:55.281 15:05:58 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:04:55.281 15:05:58 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:55.281 15:05:58 -- setup/devices.sh@50 -- # local mount_point= 00:04:55.281 15:05:58 -- setup/devices.sh@51 -- # local test_file= 00:04:55.281 15:05:58 -- setup/devices.sh@53 -- # local found=0 00:04:55.281 15:05:58 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:55.281 15:05:58 -- setup/devices.sh@59 -- # local pci status 00:04:55.281 15:05:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.281 15:05:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:04:55.281 15:05:58 -- setup/devices.sh@47 -- # setup output config 00:04:55.281 15:05:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.281 15:05:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh config 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:57.839 15:06:01 -- setup/devices.sh@63 -- # found=1 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.839 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.839 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.840 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:57.840 15:06:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:57.840 15:06:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.099 15:06:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:58.099 15:06:01 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:58.099 15:06:01 -- setup/devices.sh@68 -- # return 0 00:04:58.099 15:06:01 -- setup/devices.sh@187 -- # cleanup_dm 00:04:58.099 15:06:01 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:58.099 15:06:01 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:58.099 15:06:01 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:58.099 15:06:01 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.099 15:06:01 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:58.099 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:58.099 15:06:01 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:58.099 15:06:01 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:58.099 00:04:58.099 real 0m10.247s 00:04:58.099 user 0m2.484s 00:04:58.099 sys 0m4.829s 00:04:58.099 15:06:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.099 15:06:01 -- common/autotest_common.sh@10 -- # set +x 00:04:58.100 ************************************ 00:04:58.100 END TEST dm_mount 00:04:58.100 ************************************ 00:04:58.100 15:06:01 -- setup/devices.sh@1 -- # cleanup 00:04:58.100 15:06:01 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:58.100 15:06:01 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.100 15:06:01 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.100 15:06:01 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:58.100 15:06:01 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:58.100 15:06:01 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:58.359 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:58.359 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:58.359 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:58.359 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:58.359 15:06:02 -- setup/devices.sh@12 -- # cleanup_dm 00:04:58.359 15:06:02 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/setup/dm_mount 00:04:58.359 15:06:02 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:58.359 15:06:02 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:58.359 15:06:02 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:58.359 15:06:02 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:58.360 15:06:02 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:58.360 00:04:58.360 real 0m28.123s 00:04:58.360 user 0m8.061s 00:04:58.360 sys 0m14.878s 00:04:58.360 15:06:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.360 15:06:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.360 ************************************ 00:04:58.360 END TEST devices 00:04:58.360 ************************************ 00:04:58.360 00:04:58.360 real 1m39.154s 00:04:58.360 user 0m29.313s 00:04:58.360 sys 0m53.269s 00:04:58.360 15:06:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.360 15:06:02 -- common/autotest_common.sh@10 -- # set +x 00:04:58.360 ************************************ 00:04:58.360 END TEST setup.sh 00:04:58.360 ************************************ 00:04:58.619 15:06:02 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status 00:05:01.913 Hugepages 00:05:01.913 node hugesize free / total 00:05:01.913 node0 1048576kB 0 / 0 00:05:01.913 node0 2048kB 2048 / 2048 00:05:01.913 node1 1048576kB 0 / 0 00:05:01.913 node1 2048kB 0 / 0 00:05:01.913 00:05:01.913 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:01.913 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:05:01.913 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:05:01.913 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:05:01.913 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:05:02.173 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:05:02.173 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:05:02.173 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:05:02.173 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:05:02.174 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:05:02.174 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:05:02.174 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:05:02.174 15:06:06 -- spdk/autotest.sh@130 -- # uname -s 00:05:02.174 15:06:06 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:05:02.174 15:06:06 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:05:02.174 15:06:06 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:05:05.471 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:05.471 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:08.764 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:05:08.764 15:06:12 -- common/autotest_common.sh@1518 -- # sleep 1 00:05:09.706 15:06:13 -- common/autotest_common.sh@1519 -- # bdfs=() 00:05:09.706 15:06:13 -- common/autotest_common.sh@1519 -- # local bdfs 00:05:09.706 15:06:13 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:05:09.706 15:06:13 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:05:09.706 15:06:13 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:09.706 15:06:13 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:09.706 15:06:13 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:09.706 15:06:13 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:09.706 15:06:13 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:09.706 15:06:13 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:09.706 15:06:13 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:05:09.706 15:06:13 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:05:13.004 Waiting for block devices as requested 00:05:13.004 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:05:13.004 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:13.004 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:13.264 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:13.264 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:13.264 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:13.264 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:13.523 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:13.523 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:13.523 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:13.784 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:13.784 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:13.784 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:14.043 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:14.043 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:14.043 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:14.304 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:14.304 15:06:18 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:05:14.304 15:06:18 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:5e:00.0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1488 -- # grep 0000:5e:00.0/nvme/nvme 00:05:14.304 15:06:18 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 ]] 00:05:14.304 15:06:18 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:05:14.304 15:06:18 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1531 -- # grep oacs 00:05:14.304 15:06:18 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:05:14.304 15:06:18 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:05:14.304 15:06:18 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:05:14.304 15:06:18 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:05:14.304 15:06:18 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:14.304 15:06:18 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:05:14.304 15:06:18 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:14.304 15:06:18 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:05:14.304 15:06:18 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:05:14.304 15:06:18 -- common/autotest_common.sh@1543 -- # continue 00:05:14.304 15:06:18 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:05:14.304 15:06:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:14.304 15:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:14.304 15:06:18 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:05:14.304 15:06:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:14.304 15:06:18 -- common/autotest_common.sh@10 -- # set +x 00:05:14.304 15:06:18 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:05:17.603 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:17.603 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:20.901 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:05:20.902 15:06:24 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:05:20.902 15:06:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:20.902 15:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:20.902 15:06:24 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:05:20.902 15:06:24 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:05:20.902 15:06:24 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:05:20.902 15:06:24 -- common/autotest_common.sh@1563 -- # bdfs=() 00:05:20.902 15:06:24 -- common/autotest_common.sh@1563 -- # local bdfs 00:05:20.902 15:06:24 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:05:20.902 15:06:24 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:20.902 15:06:24 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:20.902 15:06:24 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:20.902 15:06:24 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:20.902 15:06:24 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:20.902 15:06:24 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:20.902 15:06:24 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:05:20.902 15:06:24 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:05:20.902 15:06:24 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:5e:00.0/device 00:05:20.902 15:06:24 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:05:20.902 15:06:24 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:20.902 15:06:24 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:05:20.902 15:06:24 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:5e:00.0 00:05:20.902 15:06:24 -- common/autotest_common.sh@1578 -- # [[ -z 0000:5e:00.0 ]] 00:05:20.902 15:06:24 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=486606 00:05:20.902 15:06:24 -- common/autotest_common.sh@1584 -- # waitforlisten 486606 00:05:20.902 15:06:24 -- common/autotest_common.sh@817 -- # '[' -z 486606 ']' 00:05:20.902 15:06:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.902 15:06:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:20.902 15:06:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.902 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.902 15:06:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:20.902 15:06:24 -- common/autotest_common.sh@10 -- # set +x 00:05:20.902 15:06:24 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:20.902 [2024-04-24 15:06:24.454942] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:20.902 [2024-04-24 15:06:24.455002] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid486606 ] 00:05:20.902 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.902 [2024-04-24 15:06:24.534805] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.902 [2024-04-24 15:06:24.620373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.472 15:06:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:21.472 15:06:25 -- common/autotest_common.sh@850 -- # return 0 00:05:21.472 15:06:25 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:05:21.472 15:06:25 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:05:21.472 15:06:25 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5e:00.0 00:05:24.766 nvme0n1 00:05:24.766 15:06:28 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:24.766 [2024-04-24 15:06:28.414831] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:05:24.766 request: 00:05:24.766 { 00:05:24.766 "nvme_ctrlr_name": "nvme0", 00:05:24.766 "password": "test", 00:05:24.766 "method": "bdev_nvme_opal_revert", 00:05:24.766 "req_id": 1 00:05:24.766 } 00:05:24.766 Got JSON-RPC error response 00:05:24.766 response: 00:05:24.766 { 00:05:24.766 "code": -32602, 00:05:24.766 "message": "Invalid parameters" 00:05:24.766 } 00:05:24.766 15:06:28 -- common/autotest_common.sh@1590 -- # true 00:05:24.766 15:06:28 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:05:24.766 15:06:28 -- common/autotest_common.sh@1594 -- # killprocess 486606 00:05:24.766 15:06:28 -- common/autotest_common.sh@936 -- # '[' -z 486606 ']' 00:05:24.766 15:06:28 -- common/autotest_common.sh@940 -- # kill -0 486606 00:05:24.766 15:06:28 -- common/autotest_common.sh@941 -- # uname 00:05:24.766 15:06:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.766 15:06:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 486606 00:05:24.766 15:06:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.766 15:06:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.766 15:06:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 486606' 00:05:24.766 killing process with pid 486606 00:05:24.766 15:06:28 -- common/autotest_common.sh@955 -- # kill 486606 00:05:24.766 15:06:28 -- common/autotest_common.sh@960 -- # wait 486606 00:05:28.962 15:06:32 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:05:28.963 15:06:32 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:05:28.963 15:06:32 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:28.963 15:06:32 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:28.963 15:06:32 -- spdk/autotest.sh@162 -- # timing_enter lib 00:05:28.963 15:06:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:28.963 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:28.963 15:06:32 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env.sh 00:05:28.963 15:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.963 15:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.963 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:28.963 ************************************ 00:05:28.963 START TEST env 00:05:28.963 ************************************ 00:05:28.963 15:06:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env.sh 00:05:28.963 * Looking for test storage... 00:05:28.963 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env 00:05:28.963 15:06:32 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/memory/memory_ut 00:05:28.963 15:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.963 15:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.963 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:28.963 ************************************ 00:05:28.963 START TEST env_memory 00:05:28.963 ************************************ 00:05:28.963 15:06:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/memory/memory_ut 00:05:28.963 00:05:28.963 00:05:28.963 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.963 http://cunit.sourceforge.net/ 00:05:28.963 00:05:28.963 00:05:28.963 Suite: memory 00:05:29.224 Test: alloc and free memory map ...[2024-04-24 15:06:32.889507] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:29.224 passed 00:05:29.224 Test: mem map translation ...[2024-04-24 15:06:32.908781] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:29.224 [2024-04-24 15:06:32.908795] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:29.224 [2024-04-24 15:06:32.908848] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:29.224 [2024-04-24 15:06:32.908857] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:29.224 passed 00:05:29.224 Test: mem map registration ...[2024-04-24 15:06:32.945177] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:29.224 [2024-04-24 15:06:32.945192] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:29.224 passed 00:05:29.224 Test: mem map adjacent registrations ...passed 00:05:29.224 00:05:29.224 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.224 suites 1 1 n/a 0 0 00:05:29.224 tests 4 4 4 0 0 00:05:29.224 asserts 152 152 152 0 n/a 00:05:29.224 00:05:29.224 Elapsed time = 0.134 seconds 00:05:29.224 00:05:29.224 real 0m0.147s 00:05:29.224 user 0m0.136s 00:05:29.224 sys 0m0.011s 00:05:29.224 15:06:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:29.224 15:06:32 -- common/autotest_common.sh@10 -- # set +x 00:05:29.224 ************************************ 00:05:29.224 END TEST env_memory 00:05:29.224 ************************************ 00:05:29.224 15:06:33 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:29.224 15:06:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.224 15:06:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.224 15:06:33 -- common/autotest_common.sh@10 -- # set +x 00:05:29.485 ************************************ 00:05:29.485 START TEST env_vtophys 00:05:29.485 ************************************ 00:05:29.485 15:06:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:29.485 EAL: lib.eal log level changed from notice to debug 00:05:29.485 EAL: Detected lcore 0 as core 0 on socket 0 00:05:29.485 EAL: Detected lcore 1 as core 1 on socket 0 00:05:29.485 EAL: Detected lcore 2 as core 2 on socket 0 00:05:29.485 EAL: Detected lcore 3 as core 3 on socket 0 00:05:29.485 EAL: Detected lcore 4 as core 4 on socket 0 00:05:29.485 EAL: Detected lcore 5 as core 8 on socket 0 00:05:29.485 EAL: Detected lcore 6 as core 9 on socket 0 00:05:29.485 EAL: Detected lcore 7 as core 10 on socket 0 00:05:29.485 EAL: Detected lcore 8 as core 11 on socket 0 00:05:29.485 EAL: Detected lcore 9 as core 16 on socket 0 00:05:29.485 EAL: Detected lcore 10 as core 17 on socket 0 00:05:29.485 EAL: Detected lcore 11 as core 18 on socket 0 00:05:29.485 EAL: Detected lcore 12 as core 19 on socket 0 00:05:29.485 EAL: Detected lcore 13 as core 20 on socket 0 00:05:29.485 EAL: Detected lcore 14 as core 24 on socket 0 00:05:29.485 EAL: Detected lcore 15 as core 25 on socket 0 00:05:29.485 EAL: Detected lcore 16 as core 26 on socket 0 00:05:29.485 EAL: Detected lcore 17 as core 27 on socket 0 00:05:29.485 EAL: Detected lcore 18 as core 0 on socket 1 00:05:29.485 EAL: Detected lcore 19 as core 1 on socket 1 00:05:29.485 EAL: Detected lcore 20 as core 2 on socket 1 00:05:29.485 EAL: Detected lcore 21 as core 3 on socket 1 00:05:29.485 EAL: Detected lcore 22 as core 4 on socket 1 00:05:29.485 EAL: Detected lcore 23 as core 8 on socket 1 00:05:29.485 EAL: Detected lcore 24 as core 9 on socket 1 00:05:29.485 EAL: Detected lcore 25 as core 10 on socket 1 00:05:29.485 EAL: Detected lcore 26 as core 11 on socket 1 00:05:29.485 EAL: Detected lcore 27 as core 16 on socket 1 00:05:29.485 EAL: Detected lcore 28 as core 17 on socket 1 00:05:29.485 EAL: Detected lcore 29 as core 18 on socket 1 00:05:29.485 EAL: Detected lcore 30 as core 19 on socket 1 00:05:29.485 EAL: Detected lcore 31 as core 20 on socket 1 00:05:29.485 EAL: Detected lcore 32 as core 24 on socket 1 00:05:29.485 EAL: Detected lcore 33 as core 25 on socket 1 00:05:29.485 EAL: Detected lcore 34 as core 26 on socket 1 00:05:29.485 EAL: Detected lcore 35 as core 27 on socket 1 00:05:29.485 EAL: Detected lcore 36 as core 0 on socket 0 00:05:29.485 EAL: Detected lcore 37 as core 1 on socket 0 00:05:29.485 EAL: Detected lcore 38 as core 2 on socket 0 00:05:29.485 EAL: Detected lcore 39 as core 3 on socket 0 00:05:29.485 EAL: Detected lcore 40 as core 4 on socket 0 00:05:29.485 EAL: Detected lcore 41 as core 8 on socket 0 00:05:29.485 EAL: Detected lcore 42 as core 9 on socket 0 00:05:29.485 EAL: Detected lcore 43 as core 10 on socket 0 00:05:29.485 EAL: Detected lcore 44 as core 11 on socket 0 00:05:29.485 EAL: Detected lcore 45 as core 16 on socket 0 00:05:29.485 EAL: Detected lcore 46 as core 17 on socket 0 00:05:29.485 EAL: Detected lcore 47 as core 18 on socket 0 00:05:29.485 EAL: Detected lcore 48 as core 19 on socket 0 00:05:29.485 EAL: Detected lcore 49 as core 20 on socket 0 00:05:29.485 EAL: Detected lcore 50 as core 24 on socket 0 00:05:29.485 EAL: Detected lcore 51 as core 25 on socket 0 00:05:29.485 EAL: Detected lcore 52 as core 26 on socket 0 00:05:29.485 EAL: Detected lcore 53 as core 27 on socket 0 00:05:29.485 EAL: Detected lcore 54 as core 0 on socket 1 00:05:29.485 EAL: Detected lcore 55 as core 1 on socket 1 00:05:29.485 EAL: Detected lcore 56 as core 2 on socket 1 00:05:29.485 EAL: Detected lcore 57 as core 3 on socket 1 00:05:29.485 EAL: Detected lcore 58 as core 4 on socket 1 00:05:29.485 EAL: Detected lcore 59 as core 8 on socket 1 00:05:29.485 EAL: Detected lcore 60 as core 9 on socket 1 00:05:29.485 EAL: Detected lcore 61 as core 10 on socket 1 00:05:29.485 EAL: Detected lcore 62 as core 11 on socket 1 00:05:29.485 EAL: Detected lcore 63 as core 16 on socket 1 00:05:29.485 EAL: Detected lcore 64 as core 17 on socket 1 00:05:29.485 EAL: Detected lcore 65 as core 18 on socket 1 00:05:29.485 EAL: Detected lcore 66 as core 19 on socket 1 00:05:29.485 EAL: Detected lcore 67 as core 20 on socket 1 00:05:29.485 EAL: Detected lcore 68 as core 24 on socket 1 00:05:29.486 EAL: Detected lcore 69 as core 25 on socket 1 00:05:29.486 EAL: Detected lcore 70 as core 26 on socket 1 00:05:29.486 EAL: Detected lcore 71 as core 27 on socket 1 00:05:29.486 EAL: Maximum logical cores by configuration: 128 00:05:29.486 EAL: Detected CPU lcores: 72 00:05:29.486 EAL: Detected NUMA nodes: 2 00:05:29.486 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:29.486 EAL: Detected shared linkage of DPDK 00:05:29.486 EAL: No shared files mode enabled, IPC will be disabled 00:05:29.486 EAL: Bus pci wants IOVA as 'DC' 00:05:29.486 EAL: Buses did not request a specific IOVA mode. 00:05:29.486 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:29.486 EAL: Selected IOVA mode 'VA' 00:05:29.486 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.486 EAL: Probing VFIO support... 00:05:29.486 EAL: IOMMU type 1 (Type 1) is supported 00:05:29.486 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:29.486 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:29.486 EAL: VFIO support initialized 00:05:29.486 EAL: Ask a virtual area of 0x2e000 bytes 00:05:29.486 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:29.486 EAL: Setting up physically contiguous memory... 00:05:29.486 EAL: Setting maximum number of open files to 524288 00:05:29.486 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:29.486 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:29.486 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:29.486 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:29.486 EAL: Ask a virtual area of 0x61000 bytes 00:05:29.486 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:29.486 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:29.486 EAL: Ask a virtual area of 0x400000000 bytes 00:05:29.486 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:29.486 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:29.486 EAL: Hugepages will be freed exactly as allocated. 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: TSC frequency is ~2300000 KHz 00:05:29.486 EAL: Main lcore 0 is ready (tid=7f76fbcb4a00;cpuset=[0]) 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 0 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 2MB 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:29.486 EAL: Mem event callback 'spdk:(nil)' registered 00:05:29.486 00:05:29.486 00:05:29.486 CUnit - A unit testing framework for C - Version 2.1-3 00:05:29.486 http://cunit.sourceforge.net/ 00:05:29.486 00:05:29.486 00:05:29.486 Suite: components_suite 00:05:29.486 Test: vtophys_malloc_test ...passed 00:05:29.486 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 4MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 4MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 6MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 6MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 10MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 10MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 18MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 18MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 34MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 34MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 66MB 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was shrunk by 66MB 00:05:29.486 EAL: Trying to obtain current memory policy. 00:05:29.486 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.486 EAL: Restoring previous memory policy: 4 00:05:29.486 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.486 EAL: request: mp_malloc_sync 00:05:29.486 EAL: No shared files mode enabled, IPC is disabled 00:05:29.486 EAL: Heap on socket 0 was expanded by 130MB 00:05:29.748 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.748 EAL: request: mp_malloc_sync 00:05:29.748 EAL: No shared files mode enabled, IPC is disabled 00:05:29.748 EAL: Heap on socket 0 was shrunk by 130MB 00:05:29.748 EAL: Trying to obtain current memory policy. 00:05:29.748 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.748 EAL: Restoring previous memory policy: 4 00:05:29.748 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.748 EAL: request: mp_malloc_sync 00:05:29.748 EAL: No shared files mode enabled, IPC is disabled 00:05:29.748 EAL: Heap on socket 0 was expanded by 258MB 00:05:29.748 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.748 EAL: request: mp_malloc_sync 00:05:29.748 EAL: No shared files mode enabled, IPC is disabled 00:05:29.748 EAL: Heap on socket 0 was shrunk by 258MB 00:05:29.748 EAL: Trying to obtain current memory policy. 00:05:29.748 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.008 EAL: Restoring previous memory policy: 4 00:05:30.008 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.008 EAL: request: mp_malloc_sync 00:05:30.008 EAL: No shared files mode enabled, IPC is disabled 00:05:30.008 EAL: Heap on socket 0 was expanded by 514MB 00:05:30.008 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.008 EAL: request: mp_malloc_sync 00:05:30.008 EAL: No shared files mode enabled, IPC is disabled 00:05:30.008 EAL: Heap on socket 0 was shrunk by 514MB 00:05:30.008 EAL: Trying to obtain current memory policy. 00:05:30.008 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:30.268 EAL: Restoring previous memory policy: 4 00:05:30.268 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.268 EAL: request: mp_malloc_sync 00:05:30.268 EAL: No shared files mode enabled, IPC is disabled 00:05:30.268 EAL: Heap on socket 0 was expanded by 1026MB 00:05:30.528 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.787 EAL: request: mp_malloc_sync 00:05:30.787 EAL: No shared files mode enabled, IPC is disabled 00:05:30.787 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:30.787 passed 00:05:30.787 00:05:30.787 Run Summary: Type Total Ran Passed Failed Inactive 00:05:30.787 suites 1 1 n/a 0 0 00:05:30.787 tests 2 2 2 0 0 00:05:30.787 asserts 497 497 497 0 n/a 00:05:30.787 00:05:30.787 Elapsed time = 1.122 seconds 00:05:30.787 EAL: Calling mem event callback 'spdk:(nil)' 00:05:30.787 EAL: request: mp_malloc_sync 00:05:30.787 EAL: No shared files mode enabled, IPC is disabled 00:05:30.787 EAL: Heap on socket 0 was shrunk by 2MB 00:05:30.787 EAL: No shared files mode enabled, IPC is disabled 00:05:30.787 EAL: No shared files mode enabled, IPC is disabled 00:05:30.787 EAL: No shared files mode enabled, IPC is disabled 00:05:30.787 00:05:30.787 real 0m1.266s 00:05:30.787 user 0m0.733s 00:05:30.787 sys 0m0.503s 00:05:30.787 15:06:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:30.787 15:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:30.787 ************************************ 00:05:30.787 END TEST env_vtophys 00:05:30.787 ************************************ 00:05:30.787 15:06:34 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/pci/pci_ut 00:05:30.787 15:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.787 15:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.787 15:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:30.788 ************************************ 00:05:30.788 START TEST env_pci 00:05:30.788 ************************************ 00:05:30.788 15:06:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/pci/pci_ut 00:05:30.788 00:05:30.788 00:05:30.788 CUnit - A unit testing framework for C - Version 2.1-3 00:05:30.788 http://cunit.sourceforge.net/ 00:05:30.788 00:05:30.788 00:05:30.788 Suite: pci 00:05:30.788 Test: pci_hook ...[2024-04-24 15:06:34.683078] /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 487998 has claimed it 00:05:31.047 EAL: Cannot find device (10000:00:01.0) 00:05:31.047 EAL: Failed to attach device on primary process 00:05:31.047 passed 00:05:31.047 00:05:31.047 Run Summary: Type Total Ran Passed Failed Inactive 00:05:31.047 suites 1 1 n/a 0 0 00:05:31.047 tests 1 1 1 0 0 00:05:31.047 asserts 25 25 25 0 n/a 00:05:31.047 00:05:31.047 Elapsed time = 0.036 seconds 00:05:31.047 00:05:31.047 real 0m0.058s 00:05:31.047 user 0m0.012s 00:05:31.047 sys 0m0.046s 00:05:31.047 15:06:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:31.047 15:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:31.047 ************************************ 00:05:31.047 END TEST env_pci 00:05:31.047 ************************************ 00:05:31.047 15:06:34 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:31.047 15:06:34 -- env/env.sh@15 -- # uname 00:05:31.047 15:06:34 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:31.047 15:06:34 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:31.047 15:06:34 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:31.047 15:06:34 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:31.047 15:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.047 15:06:34 -- common/autotest_common.sh@10 -- # set +x 00:05:31.047 ************************************ 00:05:31.047 START TEST env_dpdk_post_init 00:05:31.047 ************************************ 00:05:31.047 15:06:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:31.306 EAL: Detected CPU lcores: 72 00:05:31.306 EAL: Detected NUMA nodes: 2 00:05:31.306 EAL: Detected shared linkage of DPDK 00:05:31.306 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:31.306 EAL: Selected IOVA mode 'VA' 00:05:31.306 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.306 EAL: VFIO support initialized 00:05:31.306 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:31.306 EAL: Using IOMMU type 1 (Type 1) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:05:31.306 EAL: Ignore mapping IO port bar(1) 00:05:31.306 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:05:32.245 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5e:00.0 (socket 0) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:05:32.245 EAL: Ignore mapping IO port bar(1) 00:05:32.245 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:05:37.528 EAL: Releasing PCI mapped resource for 0000:5e:00.0 00:05:37.528 EAL: Calling pci_unmap_resource for 0000:5e:00.0 at 0x202001020000 00:05:37.788 Starting DPDK initialization... 00:05:37.788 Starting SPDK post initialization... 00:05:37.788 SPDK NVMe probe 00:05:37.788 Attaching to 0000:5e:00.0 00:05:37.788 Attached to 0000:5e:00.0 00:05:37.788 Cleaning up... 00:05:37.788 00:05:37.788 real 0m6.660s 00:05:37.788 user 0m5.025s 00:05:37.788 sys 0m0.701s 00:05:37.788 15:06:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:37.788 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:37.788 ************************************ 00:05:37.788 END TEST env_dpdk_post_init 00:05:37.788 ************************************ 00:05:37.788 15:06:41 -- env/env.sh@26 -- # uname 00:05:37.788 15:06:41 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:37.788 15:06:41 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:37.788 15:06:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:37.788 15:06:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.788 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:38.048 ************************************ 00:05:38.048 START TEST env_mem_callbacks 00:05:38.048 ************************************ 00:05:38.048 15:06:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:38.048 EAL: Detected CPU lcores: 72 00:05:38.048 EAL: Detected NUMA nodes: 2 00:05:38.048 EAL: Detected shared linkage of DPDK 00:05:38.048 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:38.048 EAL: Selected IOVA mode 'VA' 00:05:38.048 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.048 EAL: VFIO support initialized 00:05:38.048 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:38.048 00:05:38.048 00:05:38.049 CUnit - A unit testing framework for C - Version 2.1-3 00:05:38.049 http://cunit.sourceforge.net/ 00:05:38.049 00:05:38.049 00:05:38.049 Suite: memory 00:05:38.049 Test: test ... 00:05:38.049 register 0x200000200000 2097152 00:05:38.049 malloc 3145728 00:05:38.049 register 0x200000400000 4194304 00:05:38.049 buf 0x200000500000 len 3145728 PASSED 00:05:38.049 malloc 64 00:05:38.049 buf 0x2000004fff40 len 64 PASSED 00:05:38.049 malloc 4194304 00:05:38.049 register 0x200000800000 6291456 00:05:38.049 buf 0x200000a00000 len 4194304 PASSED 00:05:38.049 free 0x200000500000 3145728 00:05:38.049 free 0x2000004fff40 64 00:05:38.049 unregister 0x200000400000 4194304 PASSED 00:05:38.049 free 0x200000a00000 4194304 00:05:38.049 unregister 0x200000800000 6291456 PASSED 00:05:38.049 malloc 8388608 00:05:38.049 register 0x200000400000 10485760 00:05:38.049 buf 0x200000600000 len 8388608 PASSED 00:05:38.049 free 0x200000600000 8388608 00:05:38.049 unregister 0x200000400000 10485760 PASSED 00:05:38.049 passed 00:05:38.049 00:05:38.049 Run Summary: Type Total Ran Passed Failed Inactive 00:05:38.049 suites 1 1 n/a 0 0 00:05:38.049 tests 1 1 1 0 0 00:05:38.049 asserts 15 15 15 0 n/a 00:05:38.049 00:05:38.049 Elapsed time = 0.006 seconds 00:05:38.049 00:05:38.049 real 0m0.071s 00:05:38.049 user 0m0.019s 00:05:38.049 sys 0m0.052s 00:05:38.049 15:06:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.049 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:38.049 ************************************ 00:05:38.049 END TEST env_mem_callbacks 00:05:38.049 ************************************ 00:05:38.049 00:05:38.049 real 0m9.331s 00:05:38.049 user 0m6.318s 00:05:38.049 sys 0m1.964s 00:05:38.049 15:06:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:38.049 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:38.049 ************************************ 00:05:38.049 END TEST env 00:05:38.049 ************************************ 00:05:38.309 15:06:41 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/rpc.sh 00:05:38.309 15:06:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.309 15:06:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.309 15:06:41 -- common/autotest_common.sh@10 -- # set +x 00:05:38.309 ************************************ 00:05:38.309 START TEST rpc 00:05:38.309 ************************************ 00:05:38.309 15:06:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/rpc.sh 00:05:38.569 * Looking for test storage... 00:05:38.569 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:05:38.569 15:06:42 -- rpc/rpc.sh@65 -- # spdk_pid=489191 00:05:38.569 15:06:42 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:38.569 15:06:42 -- rpc/rpc.sh@67 -- # waitforlisten 489191 00:05:38.569 15:06:42 -- common/autotest_common.sh@817 -- # '[' -z 489191 ']' 00:05:38.569 15:06:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:38.569 15:06:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:38.569 15:06:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:38.569 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:38.569 15:06:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:38.569 15:06:42 -- common/autotest_common.sh@10 -- # set +x 00:05:38.569 15:06:42 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:38.569 [2024-04-24 15:06:42.294711] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:38.569 [2024-04-24 15:06:42.294772] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid489191 ] 00:05:38.569 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.569 [2024-04-24 15:06:42.375011] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.569 [2024-04-24 15:06:42.457361] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:38.569 [2024-04-24 15:06:42.457407] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 489191' to capture a snapshot of events at runtime. 00:05:38.569 [2024-04-24 15:06:42.457416] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:38.569 [2024-04-24 15:06:42.457425] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:38.569 [2024-04-24 15:06:42.457432] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid489191 for offline analysis/debug. 00:05:38.569 [2024-04-24 15:06:42.457455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.509 15:06:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:39.509 15:06:43 -- common/autotest_common.sh@850 -- # return 0 00:05:39.509 15:06:43 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:05:39.509 15:06:43 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:05:39.509 15:06:43 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:39.509 15:06:43 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:39.509 15:06:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.509 15:06:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.509 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.509 ************************************ 00:05:39.509 START TEST rpc_integrity 00:05:39.509 ************************************ 00:05:39.509 15:06:43 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:39.509 15:06:43 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:39.509 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.509 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.509 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.509 15:06:43 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:39.509 15:06:43 -- rpc/rpc.sh@13 -- # jq length 00:05:39.509 15:06:43 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:39.509 15:06:43 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:39.509 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.509 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.509 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.509 15:06:43 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:39.509 15:06:43 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:39.509 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.509 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.509 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.509 15:06:43 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:39.509 { 00:05:39.509 "name": "Malloc0", 00:05:39.509 "aliases": [ 00:05:39.509 "7fc4d340-c7ae-47e5-9e46-24c990d5aaea" 00:05:39.509 ], 00:05:39.509 "product_name": "Malloc disk", 00:05:39.509 "block_size": 512, 00:05:39.509 "num_blocks": 16384, 00:05:39.509 "uuid": "7fc4d340-c7ae-47e5-9e46-24c990d5aaea", 00:05:39.509 "assigned_rate_limits": { 00:05:39.509 "rw_ios_per_sec": 0, 00:05:39.509 "rw_mbytes_per_sec": 0, 00:05:39.509 "r_mbytes_per_sec": 0, 00:05:39.509 "w_mbytes_per_sec": 0 00:05:39.509 }, 00:05:39.509 "claimed": false, 00:05:39.509 "zoned": false, 00:05:39.509 "supported_io_types": { 00:05:39.509 "read": true, 00:05:39.509 "write": true, 00:05:39.509 "unmap": true, 00:05:39.509 "write_zeroes": true, 00:05:39.509 "flush": true, 00:05:39.509 "reset": true, 00:05:39.509 "compare": false, 00:05:39.509 "compare_and_write": false, 00:05:39.509 "abort": true, 00:05:39.509 "nvme_admin": false, 00:05:39.509 "nvme_io": false 00:05:39.509 }, 00:05:39.509 "memory_domains": [ 00:05:39.509 { 00:05:39.509 "dma_device_id": "system", 00:05:39.509 "dma_device_type": 1 00:05:39.509 }, 00:05:39.509 { 00:05:39.509 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.509 "dma_device_type": 2 00:05:39.510 } 00:05:39.510 ], 00:05:39.510 "driver_specific": {} 00:05:39.510 } 00:05:39.510 ]' 00:05:39.510 15:06:43 -- rpc/rpc.sh@17 -- # jq length 00:05:39.510 15:06:43 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:39.510 15:06:43 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:39.510 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.510 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.510 [2024-04-24 15:06:43.349619] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:39.510 [2024-04-24 15:06:43.349653] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:39.510 [2024-04-24 15:06:43.349668] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xaa6360 00:05:39.510 [2024-04-24 15:06:43.349677] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:39.510 [2024-04-24 15:06:43.350796] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:39.510 [2024-04-24 15:06:43.350820] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:39.510 Passthru0 00:05:39.510 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.510 15:06:43 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:39.510 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.510 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.510 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.510 15:06:43 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:39.510 { 00:05:39.510 "name": "Malloc0", 00:05:39.510 "aliases": [ 00:05:39.510 "7fc4d340-c7ae-47e5-9e46-24c990d5aaea" 00:05:39.510 ], 00:05:39.510 "product_name": "Malloc disk", 00:05:39.510 "block_size": 512, 00:05:39.510 "num_blocks": 16384, 00:05:39.510 "uuid": "7fc4d340-c7ae-47e5-9e46-24c990d5aaea", 00:05:39.510 "assigned_rate_limits": { 00:05:39.510 "rw_ios_per_sec": 0, 00:05:39.510 "rw_mbytes_per_sec": 0, 00:05:39.510 "r_mbytes_per_sec": 0, 00:05:39.510 "w_mbytes_per_sec": 0 00:05:39.510 }, 00:05:39.510 "claimed": true, 00:05:39.510 "claim_type": "exclusive_write", 00:05:39.510 "zoned": false, 00:05:39.510 "supported_io_types": { 00:05:39.510 "read": true, 00:05:39.510 "write": true, 00:05:39.510 "unmap": true, 00:05:39.510 "write_zeroes": true, 00:05:39.510 "flush": true, 00:05:39.510 "reset": true, 00:05:39.510 "compare": false, 00:05:39.510 "compare_and_write": false, 00:05:39.510 "abort": true, 00:05:39.510 "nvme_admin": false, 00:05:39.510 "nvme_io": false 00:05:39.510 }, 00:05:39.510 "memory_domains": [ 00:05:39.510 { 00:05:39.510 "dma_device_id": "system", 00:05:39.510 "dma_device_type": 1 00:05:39.510 }, 00:05:39.510 { 00:05:39.510 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.510 "dma_device_type": 2 00:05:39.510 } 00:05:39.510 ], 00:05:39.510 "driver_specific": {} 00:05:39.510 }, 00:05:39.510 { 00:05:39.510 "name": "Passthru0", 00:05:39.510 "aliases": [ 00:05:39.510 "3e8d7e06-31b6-5277-aa99-8440df5f6a9b" 00:05:39.510 ], 00:05:39.510 "product_name": "passthru", 00:05:39.510 "block_size": 512, 00:05:39.510 "num_blocks": 16384, 00:05:39.510 "uuid": "3e8d7e06-31b6-5277-aa99-8440df5f6a9b", 00:05:39.510 "assigned_rate_limits": { 00:05:39.510 "rw_ios_per_sec": 0, 00:05:39.510 "rw_mbytes_per_sec": 0, 00:05:39.510 "r_mbytes_per_sec": 0, 00:05:39.510 "w_mbytes_per_sec": 0 00:05:39.510 }, 00:05:39.510 "claimed": false, 00:05:39.510 "zoned": false, 00:05:39.510 "supported_io_types": { 00:05:39.510 "read": true, 00:05:39.510 "write": true, 00:05:39.510 "unmap": true, 00:05:39.510 "write_zeroes": true, 00:05:39.510 "flush": true, 00:05:39.510 "reset": true, 00:05:39.510 "compare": false, 00:05:39.510 "compare_and_write": false, 00:05:39.510 "abort": true, 00:05:39.510 "nvme_admin": false, 00:05:39.510 "nvme_io": false 00:05:39.510 }, 00:05:39.510 "memory_domains": [ 00:05:39.510 { 00:05:39.510 "dma_device_id": "system", 00:05:39.510 "dma_device_type": 1 00:05:39.510 }, 00:05:39.510 { 00:05:39.510 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:39.510 "dma_device_type": 2 00:05:39.510 } 00:05:39.510 ], 00:05:39.510 "driver_specific": { 00:05:39.510 "passthru": { 00:05:39.510 "name": "Passthru0", 00:05:39.510 "base_bdev_name": "Malloc0" 00:05:39.510 } 00:05:39.510 } 00:05:39.510 } 00:05:39.510 ]' 00:05:39.510 15:06:43 -- rpc/rpc.sh@21 -- # jq length 00:05:39.510 15:06:43 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:39.510 15:06:43 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:39.510 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.510 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.770 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.770 15:06:43 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:39.770 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.770 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.770 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.770 15:06:43 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:39.770 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:39.770 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.770 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:39.770 15:06:43 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:39.770 15:06:43 -- rpc/rpc.sh@26 -- # jq length 00:05:39.770 15:06:43 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:39.770 00:05:39.770 real 0m0.267s 00:05:39.770 user 0m0.165s 00:05:39.770 sys 0m0.041s 00:05:39.770 15:06:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.770 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:39.770 ************************************ 00:05:39.770 END TEST rpc_integrity 00:05:39.770 ************************************ 00:05:39.770 15:06:43 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:39.770 15:06:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.770 15:06:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.770 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 ************************************ 00:05:40.030 START TEST rpc_plugins 00:05:40.030 ************************************ 00:05:40.030 15:06:43 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:05:40.030 15:06:43 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:40.030 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.030 15:06:43 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:40.030 15:06:43 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:40.030 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.030 15:06:43 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:40.030 { 00:05:40.030 "name": "Malloc1", 00:05:40.030 "aliases": [ 00:05:40.030 "cf6d0b3f-8254-4539-b031-1e59dc1f74b2" 00:05:40.030 ], 00:05:40.030 "product_name": "Malloc disk", 00:05:40.030 "block_size": 4096, 00:05:40.030 "num_blocks": 256, 00:05:40.030 "uuid": "cf6d0b3f-8254-4539-b031-1e59dc1f74b2", 00:05:40.030 "assigned_rate_limits": { 00:05:40.030 "rw_ios_per_sec": 0, 00:05:40.030 "rw_mbytes_per_sec": 0, 00:05:40.030 "r_mbytes_per_sec": 0, 00:05:40.030 "w_mbytes_per_sec": 0 00:05:40.030 }, 00:05:40.030 "claimed": false, 00:05:40.030 "zoned": false, 00:05:40.030 "supported_io_types": { 00:05:40.030 "read": true, 00:05:40.030 "write": true, 00:05:40.030 "unmap": true, 00:05:40.030 "write_zeroes": true, 00:05:40.030 "flush": true, 00:05:40.030 "reset": true, 00:05:40.030 "compare": false, 00:05:40.030 "compare_and_write": false, 00:05:40.030 "abort": true, 00:05:40.030 "nvme_admin": false, 00:05:40.030 "nvme_io": false 00:05:40.030 }, 00:05:40.030 "memory_domains": [ 00:05:40.030 { 00:05:40.030 "dma_device_id": "system", 00:05:40.030 "dma_device_type": 1 00:05:40.030 }, 00:05:40.030 { 00:05:40.030 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.030 "dma_device_type": 2 00:05:40.030 } 00:05:40.030 ], 00:05:40.030 "driver_specific": {} 00:05:40.030 } 00:05:40.030 ]' 00:05:40.030 15:06:43 -- rpc/rpc.sh@32 -- # jq length 00:05:40.030 15:06:43 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:40.030 15:06:43 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:40.030 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.030 15:06:43 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:40.030 15:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 15:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.030 15:06:43 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:40.030 15:06:43 -- rpc/rpc.sh@36 -- # jq length 00:05:40.030 15:06:43 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:40.030 00:05:40.030 real 0m0.136s 00:05:40.030 user 0m0.083s 00:05:40.030 sys 0m0.027s 00:05:40.030 15:06:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.030 ************************************ 00:05:40.030 END TEST rpc_plugins 00:05:40.030 ************************************ 00:05:40.030 15:06:43 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:40.030 15:06:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.030 15:06:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.030 15:06:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.291 ************************************ 00:05:40.291 START TEST rpc_trace_cmd_test 00:05:40.291 ************************************ 00:05:40.291 15:06:44 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:05:40.291 15:06:44 -- rpc/rpc.sh@40 -- # local info 00:05:40.291 15:06:44 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:40.291 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.291 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.291 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.291 15:06:44 -- rpc/rpc.sh@42 -- # info='{ 00:05:40.291 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid489191", 00:05:40.291 "tpoint_group_mask": "0x8", 00:05:40.291 "iscsi_conn": { 00:05:40.291 "mask": "0x2", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "scsi": { 00:05:40.291 "mask": "0x4", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "bdev": { 00:05:40.291 "mask": "0x8", 00:05:40.291 "tpoint_mask": "0xffffffffffffffff" 00:05:40.291 }, 00:05:40.291 "nvmf_rdma": { 00:05:40.291 "mask": "0x10", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "nvmf_tcp": { 00:05:40.291 "mask": "0x20", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "ftl": { 00:05:40.291 "mask": "0x40", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "blobfs": { 00:05:40.291 "mask": "0x80", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "dsa": { 00:05:40.291 "mask": "0x200", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "thread": { 00:05:40.291 "mask": "0x400", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "nvme_pcie": { 00:05:40.291 "mask": "0x800", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "iaa": { 00:05:40.291 "mask": "0x1000", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "nvme_tcp": { 00:05:40.291 "mask": "0x2000", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "bdev_nvme": { 00:05:40.291 "mask": "0x4000", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 }, 00:05:40.291 "sock": { 00:05:40.291 "mask": "0x8000", 00:05:40.291 "tpoint_mask": "0x0" 00:05:40.291 } 00:05:40.291 }' 00:05:40.291 15:06:44 -- rpc/rpc.sh@43 -- # jq length 00:05:40.291 15:06:44 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:05:40.291 15:06:44 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:40.291 15:06:44 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:40.291 15:06:44 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:40.291 15:06:44 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:40.291 15:06:44 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:40.551 15:06:44 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:40.551 15:06:44 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:40.551 15:06:44 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:40.551 00:05:40.551 real 0m0.224s 00:05:40.551 user 0m0.184s 00:05:40.551 sys 0m0.033s 00:05:40.551 15:06:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.551 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.551 ************************************ 00:05:40.551 END TEST rpc_trace_cmd_test 00:05:40.551 ************************************ 00:05:40.551 15:06:44 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:40.551 15:06:44 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:40.551 15:06:44 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:40.551 15:06:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.551 15:06:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.551 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.551 ************************************ 00:05:40.551 START TEST rpc_daemon_integrity 00:05:40.551 ************************************ 00:05:40.551 15:06:44 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:40.551 15:06:44 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.551 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.551 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.820 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:40.821 15:06:44 -- rpc/rpc.sh@13 -- # jq length 00:05:40.821 15:06:44 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:40.821 15:06:44 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:40.821 15:06:44 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:40.821 { 00:05:40.821 "name": "Malloc2", 00:05:40.821 "aliases": [ 00:05:40.821 "fbc77d57-847f-4ad0-8beb-cc060c0140b5" 00:05:40.821 ], 00:05:40.821 "product_name": "Malloc disk", 00:05:40.821 "block_size": 512, 00:05:40.821 "num_blocks": 16384, 00:05:40.821 "uuid": "fbc77d57-847f-4ad0-8beb-cc060c0140b5", 00:05:40.821 "assigned_rate_limits": { 00:05:40.821 "rw_ios_per_sec": 0, 00:05:40.821 "rw_mbytes_per_sec": 0, 00:05:40.821 "r_mbytes_per_sec": 0, 00:05:40.821 "w_mbytes_per_sec": 0 00:05:40.821 }, 00:05:40.821 "claimed": false, 00:05:40.821 "zoned": false, 00:05:40.821 "supported_io_types": { 00:05:40.821 "read": true, 00:05:40.821 "write": true, 00:05:40.821 "unmap": true, 00:05:40.821 "write_zeroes": true, 00:05:40.821 "flush": true, 00:05:40.821 "reset": true, 00:05:40.821 "compare": false, 00:05:40.821 "compare_and_write": false, 00:05:40.821 "abort": true, 00:05:40.821 "nvme_admin": false, 00:05:40.821 "nvme_io": false 00:05:40.821 }, 00:05:40.821 "memory_domains": [ 00:05:40.821 { 00:05:40.821 "dma_device_id": "system", 00:05:40.821 "dma_device_type": 1 00:05:40.821 }, 00:05:40.821 { 00:05:40.821 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.821 "dma_device_type": 2 00:05:40.821 } 00:05:40.821 ], 00:05:40.821 "driver_specific": {} 00:05:40.821 } 00:05:40.821 ]' 00:05:40.821 15:06:44 -- rpc/rpc.sh@17 -- # jq length 00:05:40.821 15:06:44 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:40.821 15:06:44 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 [2024-04-24 15:06:44.584985] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:40.821 [2024-04-24 15:06:44.585015] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:40.821 [2024-04-24 15:06:44.585031] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xc4a770 00:05:40.821 [2024-04-24 15:06:44.585040] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:40.821 [2024-04-24 15:06:44.586004] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:40.821 [2024-04-24 15:06:44.586027] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:40.821 Passthru0 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:40.821 { 00:05:40.821 "name": "Malloc2", 00:05:40.821 "aliases": [ 00:05:40.821 "fbc77d57-847f-4ad0-8beb-cc060c0140b5" 00:05:40.821 ], 00:05:40.821 "product_name": "Malloc disk", 00:05:40.821 "block_size": 512, 00:05:40.821 "num_blocks": 16384, 00:05:40.821 "uuid": "fbc77d57-847f-4ad0-8beb-cc060c0140b5", 00:05:40.821 "assigned_rate_limits": { 00:05:40.821 "rw_ios_per_sec": 0, 00:05:40.821 "rw_mbytes_per_sec": 0, 00:05:40.821 "r_mbytes_per_sec": 0, 00:05:40.821 "w_mbytes_per_sec": 0 00:05:40.821 }, 00:05:40.821 "claimed": true, 00:05:40.821 "claim_type": "exclusive_write", 00:05:40.821 "zoned": false, 00:05:40.821 "supported_io_types": { 00:05:40.821 "read": true, 00:05:40.821 "write": true, 00:05:40.821 "unmap": true, 00:05:40.821 "write_zeroes": true, 00:05:40.821 "flush": true, 00:05:40.821 "reset": true, 00:05:40.821 "compare": false, 00:05:40.821 "compare_and_write": false, 00:05:40.821 "abort": true, 00:05:40.821 "nvme_admin": false, 00:05:40.821 "nvme_io": false 00:05:40.821 }, 00:05:40.821 "memory_domains": [ 00:05:40.821 { 00:05:40.821 "dma_device_id": "system", 00:05:40.821 "dma_device_type": 1 00:05:40.821 }, 00:05:40.821 { 00:05:40.821 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.821 "dma_device_type": 2 00:05:40.821 } 00:05:40.821 ], 00:05:40.821 "driver_specific": {} 00:05:40.821 }, 00:05:40.821 { 00:05:40.821 "name": "Passthru0", 00:05:40.821 "aliases": [ 00:05:40.821 "44ec0c97-9304-5b6d-9808-e85904a18f4c" 00:05:40.821 ], 00:05:40.821 "product_name": "passthru", 00:05:40.821 "block_size": 512, 00:05:40.821 "num_blocks": 16384, 00:05:40.821 "uuid": "44ec0c97-9304-5b6d-9808-e85904a18f4c", 00:05:40.821 "assigned_rate_limits": { 00:05:40.821 "rw_ios_per_sec": 0, 00:05:40.821 "rw_mbytes_per_sec": 0, 00:05:40.821 "r_mbytes_per_sec": 0, 00:05:40.821 "w_mbytes_per_sec": 0 00:05:40.821 }, 00:05:40.821 "claimed": false, 00:05:40.821 "zoned": false, 00:05:40.821 "supported_io_types": { 00:05:40.821 "read": true, 00:05:40.821 "write": true, 00:05:40.821 "unmap": true, 00:05:40.821 "write_zeroes": true, 00:05:40.821 "flush": true, 00:05:40.821 "reset": true, 00:05:40.821 "compare": false, 00:05:40.821 "compare_and_write": false, 00:05:40.821 "abort": true, 00:05:40.821 "nvme_admin": false, 00:05:40.821 "nvme_io": false 00:05:40.821 }, 00:05:40.821 "memory_domains": [ 00:05:40.821 { 00:05:40.821 "dma_device_id": "system", 00:05:40.821 "dma_device_type": 1 00:05:40.821 }, 00:05:40.821 { 00:05:40.821 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.821 "dma_device_type": 2 00:05:40.821 } 00:05:40.821 ], 00:05:40.821 "driver_specific": { 00:05:40.821 "passthru": { 00:05:40.821 "name": "Passthru0", 00:05:40.821 "base_bdev_name": "Malloc2" 00:05:40.821 } 00:05:40.821 } 00:05:40.821 } 00:05:40.821 ]' 00:05:40.821 15:06:44 -- rpc/rpc.sh@21 -- # jq length 00:05:40.821 15:06:44 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:40.821 15:06:44 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:40.821 15:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:40.821 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:40.821 15:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:40.821 15:06:44 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:40.821 15:06:44 -- rpc/rpc.sh@26 -- # jq length 00:05:40.821 15:06:44 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:40.821 00:05:40.821 real 0m0.268s 00:05:40.821 user 0m0.166s 00:05:40.821 sys 0m0.052s 00:05:41.084 15:06:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.084 15:06:44 -- common/autotest_common.sh@10 -- # set +x 00:05:41.084 ************************************ 00:05:41.084 END TEST rpc_daemon_integrity 00:05:41.084 ************************************ 00:05:41.084 15:06:44 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:41.084 15:06:44 -- rpc/rpc.sh@84 -- # killprocess 489191 00:05:41.084 15:06:44 -- common/autotest_common.sh@936 -- # '[' -z 489191 ']' 00:05:41.084 15:06:44 -- common/autotest_common.sh@940 -- # kill -0 489191 00:05:41.084 15:06:44 -- common/autotest_common.sh@941 -- # uname 00:05:41.084 15:06:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:41.084 15:06:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 489191 00:05:41.084 15:06:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:41.084 15:06:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:41.084 15:06:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 489191' 00:05:41.084 killing process with pid 489191 00:05:41.084 15:06:44 -- common/autotest_common.sh@955 -- # kill 489191 00:05:41.084 15:06:44 -- common/autotest_common.sh@960 -- # wait 489191 00:05:41.343 00:05:41.343 real 0m3.056s 00:05:41.343 user 0m3.849s 00:05:41.343 sys 0m1.046s 00:05:41.343 15:06:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:41.343 15:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:41.343 ************************************ 00:05:41.343 END TEST rpc 00:05:41.343 ************************************ 00:05:41.343 15:06:45 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.343 15:06:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.343 15:06:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.343 15:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:41.603 ************************************ 00:05:41.603 START TEST skip_rpc 00:05:41.603 ************************************ 00:05:41.603 15:06:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:05:41.603 * Looking for test storage... 00:05:41.603 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc 00:05:41.603 15:06:45 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:05:41.603 15:06:45 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:05:41.603 15:06:45 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:05:41.603 15:06:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.603 15:06:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.603 15:06:45 -- common/autotest_common.sh@10 -- # set +x 00:05:41.863 ************************************ 00:05:41.863 START TEST skip_rpc 00:05:41.863 ************************************ 00:05:41.863 15:06:45 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:05:41.863 15:06:45 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=489848 00:05:41.863 15:06:45 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:41.863 15:06:45 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:05:41.863 15:06:45 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:05:41.863 [2024-04-24 15:06:45.705025] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:41.863 [2024-04-24 15:06:45.705069] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid489848 ] 00:05:41.863 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.122 [2024-04-24 15:06:45.785779] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.122 [2024-04-24 15:06:45.862603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.423 15:06:50 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:05:47.424 15:06:50 -- common/autotest_common.sh@638 -- # local es=0 00:05:47.424 15:06:50 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:05:47.424 15:06:50 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:47.424 15:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.424 15:06:50 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:47.424 15:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:47.424 15:06:50 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:05:47.424 15:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:47.424 15:06:50 -- common/autotest_common.sh@10 -- # set +x 00:05:47.424 15:06:50 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:47.424 15:06:50 -- common/autotest_common.sh@641 -- # es=1 00:05:47.424 15:06:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:47.424 15:06:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:47.424 15:06:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:47.424 15:06:50 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:05:47.424 15:06:50 -- rpc/skip_rpc.sh@23 -- # killprocess 489848 00:05:47.424 15:06:50 -- common/autotest_common.sh@936 -- # '[' -z 489848 ']' 00:05:47.424 15:06:50 -- common/autotest_common.sh@940 -- # kill -0 489848 00:05:47.424 15:06:50 -- common/autotest_common.sh@941 -- # uname 00:05:47.424 15:06:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:47.424 15:06:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 489848 00:05:47.424 15:06:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:47.424 15:06:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:47.424 15:06:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 489848' 00:05:47.424 killing process with pid 489848 00:05:47.424 15:06:50 -- common/autotest_common.sh@955 -- # kill 489848 00:05:47.424 15:06:50 -- common/autotest_common.sh@960 -- # wait 489848 00:05:47.424 00:05:47.424 real 0m5.443s 00:05:47.424 user 0m5.172s 00:05:47.424 sys 0m0.305s 00:05:47.424 15:06:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.424 15:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:47.424 ************************************ 00:05:47.424 END TEST skip_rpc 00:05:47.424 ************************************ 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:05:47.424 15:06:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:47.424 15:06:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.424 15:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:47.424 ************************************ 00:05:47.424 START TEST skip_rpc_with_json 00:05:47.424 ************************************ 00:05:47.424 15:06:51 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=490661 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@31 -- # waitforlisten 490661 00:05:47.424 15:06:51 -- common/autotest_common.sh@817 -- # '[' -z 490661 ']' 00:05:47.424 15:06:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.424 15:06:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:47.424 15:06:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.424 15:06:51 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:47.424 15:06:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:47.424 15:06:51 -- common/autotest_common.sh@10 -- # set +x 00:05:47.424 [2024-04-24 15:06:51.332328] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:47.424 [2024-04-24 15:06:51.332380] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid490661 ] 00:05:47.684 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.684 [2024-04-24 15:06:51.411856] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.684 [2024-04-24 15:06:51.497232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.253 15:06:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:48.253 15:06:52 -- common/autotest_common.sh@850 -- # return 0 00:05:48.253 15:06:52 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:05:48.253 15:06:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:48.253 15:06:52 -- common/autotest_common.sh@10 -- # set +x 00:05:48.253 [2024-04-24 15:06:52.126630] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:05:48.253 request: 00:05:48.253 { 00:05:48.253 "trtype": "tcp", 00:05:48.253 "method": "nvmf_get_transports", 00:05:48.253 "req_id": 1 00:05:48.253 } 00:05:48.253 Got JSON-RPC error response 00:05:48.253 response: 00:05:48.253 { 00:05:48.253 "code": -19, 00:05:48.253 "message": "No such device" 00:05:48.253 } 00:05:48.253 15:06:52 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:48.253 15:06:52 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:05:48.253 15:06:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:48.253 15:06:52 -- common/autotest_common.sh@10 -- # set +x 00:05:48.253 [2024-04-24 15:06:52.134714] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:48.253 15:06:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:48.254 15:06:52 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:05:48.254 15:06:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:48.254 15:06:52 -- common/autotest_common.sh@10 -- # set +x 00:05:48.514 15:06:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:48.514 15:06:52 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:05:48.514 { 00:05:48.514 "subsystems": [ 00:05:48.514 { 00:05:48.514 "subsystem": "keyring", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "iobuf", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "iobuf_set_options", 00:05:48.514 "params": { 00:05:48.514 "small_pool_count": 8192, 00:05:48.514 "large_pool_count": 1024, 00:05:48.514 "small_bufsize": 8192, 00:05:48.514 "large_bufsize": 135168 00:05:48.514 } 00:05:48.514 } 00:05:48.514 ] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "sock", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "sock_impl_set_options", 00:05:48.514 "params": { 00:05:48.514 "impl_name": "posix", 00:05:48.514 "recv_buf_size": 2097152, 00:05:48.514 "send_buf_size": 2097152, 00:05:48.514 "enable_recv_pipe": true, 00:05:48.514 "enable_quickack": false, 00:05:48.514 "enable_placement_id": 0, 00:05:48.514 "enable_zerocopy_send_server": true, 00:05:48.514 "enable_zerocopy_send_client": false, 00:05:48.514 "zerocopy_threshold": 0, 00:05:48.514 "tls_version": 0, 00:05:48.514 "enable_ktls": false 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "sock_impl_set_options", 00:05:48.514 "params": { 00:05:48.514 "impl_name": "ssl", 00:05:48.514 "recv_buf_size": 4096, 00:05:48.514 "send_buf_size": 4096, 00:05:48.514 "enable_recv_pipe": true, 00:05:48.514 "enable_quickack": false, 00:05:48.514 "enable_placement_id": 0, 00:05:48.514 "enable_zerocopy_send_server": true, 00:05:48.514 "enable_zerocopy_send_client": false, 00:05:48.514 "zerocopy_threshold": 0, 00:05:48.514 "tls_version": 0, 00:05:48.514 "enable_ktls": false 00:05:48.514 } 00:05:48.514 } 00:05:48.514 ] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "vmd", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "accel", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "accel_set_options", 00:05:48.514 "params": { 00:05:48.514 "small_cache_size": 128, 00:05:48.514 "large_cache_size": 16, 00:05:48.514 "task_count": 2048, 00:05:48.514 "sequence_count": 2048, 00:05:48.514 "buf_count": 2048 00:05:48.514 } 00:05:48.514 } 00:05:48.514 ] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "bdev", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "bdev_set_options", 00:05:48.514 "params": { 00:05:48.514 "bdev_io_pool_size": 65535, 00:05:48.514 "bdev_io_cache_size": 256, 00:05:48.514 "bdev_auto_examine": true, 00:05:48.514 "iobuf_small_cache_size": 128, 00:05:48.514 "iobuf_large_cache_size": 16 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "bdev_raid_set_options", 00:05:48.514 "params": { 00:05:48.514 "process_window_size_kb": 1024 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "bdev_iscsi_set_options", 00:05:48.514 "params": { 00:05:48.514 "timeout_sec": 30 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "bdev_nvme_set_options", 00:05:48.514 "params": { 00:05:48.514 "action_on_timeout": "none", 00:05:48.514 "timeout_us": 0, 00:05:48.514 "timeout_admin_us": 0, 00:05:48.514 "keep_alive_timeout_ms": 10000, 00:05:48.514 "arbitration_burst": 0, 00:05:48.514 "low_priority_weight": 0, 00:05:48.514 "medium_priority_weight": 0, 00:05:48.514 "high_priority_weight": 0, 00:05:48.514 "nvme_adminq_poll_period_us": 10000, 00:05:48.514 "nvme_ioq_poll_period_us": 0, 00:05:48.514 "io_queue_requests": 0, 00:05:48.514 "delay_cmd_submit": true, 00:05:48.514 "transport_retry_count": 4, 00:05:48.514 "bdev_retry_count": 3, 00:05:48.514 "transport_ack_timeout": 0, 00:05:48.514 "ctrlr_loss_timeout_sec": 0, 00:05:48.514 "reconnect_delay_sec": 0, 00:05:48.514 "fast_io_fail_timeout_sec": 0, 00:05:48.514 "disable_auto_failback": false, 00:05:48.514 "generate_uuids": false, 00:05:48.514 "transport_tos": 0, 00:05:48.514 "nvme_error_stat": false, 00:05:48.514 "rdma_srq_size": 0, 00:05:48.514 "io_path_stat": false, 00:05:48.514 "allow_accel_sequence": false, 00:05:48.514 "rdma_max_cq_size": 0, 00:05:48.514 "rdma_cm_event_timeout_ms": 0, 00:05:48.514 "dhchap_digests": [ 00:05:48.514 "sha256", 00:05:48.514 "sha384", 00:05:48.514 "sha512" 00:05:48.514 ], 00:05:48.514 "dhchap_dhgroups": [ 00:05:48.514 "null", 00:05:48.514 "ffdhe2048", 00:05:48.514 "ffdhe3072", 00:05:48.514 "ffdhe4096", 00:05:48.514 "ffdhe6144", 00:05:48.514 "ffdhe8192" 00:05:48.514 ] 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "bdev_nvme_set_hotplug", 00:05:48.514 "params": { 00:05:48.514 "period_us": 100000, 00:05:48.514 "enable": false 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "bdev_wait_for_examine" 00:05:48.514 } 00:05:48.514 ] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "scsi", 00:05:48.514 "config": null 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "scheduler", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "framework_set_scheduler", 00:05:48.514 "params": { 00:05:48.514 "name": "static" 00:05:48.514 } 00:05:48.514 } 00:05:48.514 ] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "vhost_scsi", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "vhost_blk", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "ublk", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "nbd", 00:05:48.514 "config": [] 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "subsystem": "nvmf", 00:05:48.514 "config": [ 00:05:48.514 { 00:05:48.514 "method": "nvmf_set_config", 00:05:48.514 "params": { 00:05:48.514 "discovery_filter": "match_any", 00:05:48.514 "admin_cmd_passthru": { 00:05:48.514 "identify_ctrlr": false 00:05:48.514 } 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "nvmf_set_max_subsystems", 00:05:48.514 "params": { 00:05:48.514 "max_subsystems": 1024 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "nvmf_set_crdt", 00:05:48.514 "params": { 00:05:48.514 "crdt1": 0, 00:05:48.514 "crdt2": 0, 00:05:48.514 "crdt3": 0 00:05:48.514 } 00:05:48.514 }, 00:05:48.514 { 00:05:48.514 "method": "nvmf_create_transport", 00:05:48.514 "params": { 00:05:48.514 "trtype": "TCP", 00:05:48.514 "max_queue_depth": 128, 00:05:48.514 "max_io_qpairs_per_ctrlr": 127, 00:05:48.514 "in_capsule_data_size": 4096, 00:05:48.514 "max_io_size": 131072, 00:05:48.514 "io_unit_size": 131072, 00:05:48.515 "max_aq_depth": 128, 00:05:48.515 "num_shared_buffers": 511, 00:05:48.515 "buf_cache_size": 4294967295, 00:05:48.515 "dif_insert_or_strip": false, 00:05:48.515 "zcopy": false, 00:05:48.515 "c2h_success": true, 00:05:48.515 "sock_priority": 0, 00:05:48.515 "abort_timeout_sec": 1, 00:05:48.515 "ack_timeout": 0, 00:05:48.515 "data_wr_pool_size": 0 00:05:48.515 } 00:05:48.515 } 00:05:48.515 ] 00:05:48.515 }, 00:05:48.515 { 00:05:48.515 "subsystem": "iscsi", 00:05:48.515 "config": [ 00:05:48.515 { 00:05:48.515 "method": "iscsi_set_options", 00:05:48.515 "params": { 00:05:48.515 "node_base": "iqn.2016-06.io.spdk", 00:05:48.515 "max_sessions": 128, 00:05:48.515 "max_connections_per_session": 2, 00:05:48.515 "max_queue_depth": 64, 00:05:48.515 "default_time2wait": 2, 00:05:48.515 "default_time2retain": 20, 00:05:48.515 "first_burst_length": 8192, 00:05:48.515 "immediate_data": true, 00:05:48.515 "allow_duplicated_isid": false, 00:05:48.515 "error_recovery_level": 0, 00:05:48.515 "nop_timeout": 60, 00:05:48.515 "nop_in_interval": 30, 00:05:48.515 "disable_chap": false, 00:05:48.515 "require_chap": false, 00:05:48.515 "mutual_chap": false, 00:05:48.515 "chap_group": 0, 00:05:48.515 "max_large_datain_per_connection": 64, 00:05:48.515 "max_r2t_per_connection": 4, 00:05:48.515 "pdu_pool_size": 36864, 00:05:48.515 "immediate_data_pool_size": 16384, 00:05:48.515 "data_out_pool_size": 2048 00:05:48.515 } 00:05:48.515 } 00:05:48.515 ] 00:05:48.515 } 00:05:48.515 ] 00:05:48.515 } 00:05:48.515 15:06:52 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:05:48.515 15:06:52 -- rpc/skip_rpc.sh@40 -- # killprocess 490661 00:05:48.515 15:06:52 -- common/autotest_common.sh@936 -- # '[' -z 490661 ']' 00:05:48.515 15:06:52 -- common/autotest_common.sh@940 -- # kill -0 490661 00:05:48.515 15:06:52 -- common/autotest_common.sh@941 -- # uname 00:05:48.515 15:06:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.515 15:06:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 490661 00:05:48.515 15:06:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.515 15:06:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.515 15:06:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 490661' 00:05:48.515 killing process with pid 490661 00:05:48.515 15:06:52 -- common/autotest_common.sh@955 -- # kill 490661 00:05:48.515 15:06:52 -- common/autotest_common.sh@960 -- # wait 490661 00:05:49.084 15:06:52 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=490852 00:05:49.084 15:06:52 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:05:49.084 15:06:52 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:05:54.367 15:06:57 -- rpc/skip_rpc.sh@50 -- # killprocess 490852 00:05:54.367 15:06:57 -- common/autotest_common.sh@936 -- # '[' -z 490852 ']' 00:05:54.367 15:06:57 -- common/autotest_common.sh@940 -- # kill -0 490852 00:05:54.367 15:06:57 -- common/autotest_common.sh@941 -- # uname 00:05:54.367 15:06:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:54.367 15:06:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 490852 00:05:54.367 15:06:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:54.367 15:06:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:54.367 15:06:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 490852' 00:05:54.367 killing process with pid 490852 00:05:54.367 15:06:57 -- common/autotest_common.sh@955 -- # kill 490852 00:05:54.367 15:06:57 -- common/autotest_common.sh@960 -- # wait 490852 00:05:54.367 15:06:58 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:05:54.367 15:06:58 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/log.txt 00:05:54.367 00:05:54.367 real 0m6.850s 00:05:54.367 user 0m6.571s 00:05:54.367 sys 0m0.683s 00:05:54.367 15:06:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.367 15:06:58 -- common/autotest_common.sh@10 -- # set +x 00:05:54.367 ************************************ 00:05:54.367 END TEST skip_rpc_with_json 00:05:54.367 ************************************ 00:05:54.367 15:06:58 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:05:54.367 15:06:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.367 15:06:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.367 15:06:58 -- common/autotest_common.sh@10 -- # set +x 00:05:54.627 ************************************ 00:05:54.627 START TEST skip_rpc_with_delay 00:05:54.627 ************************************ 00:05:54.627 15:06:58 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.627 15:06:58 -- common/autotest_common.sh@638 -- # local es=0 00:05:54.627 15:06:58 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.627 15:06:58 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.627 15:06:58 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.627 15:06:58 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.627 15:06:58 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.627 15:06:58 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.627 15:06:58 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:54.627 15:06:58 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.627 15:06:58 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:54.627 15:06:58 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:54.627 [2024-04-24 15:06:58.350961] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:05:54.627 [2024-04-24 15:06:58.351029] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:05:54.627 15:06:58 -- common/autotest_common.sh@641 -- # es=1 00:05:54.627 15:06:58 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:54.627 15:06:58 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:54.627 15:06:58 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:54.627 00:05:54.627 real 0m0.068s 00:05:54.627 user 0m0.032s 00:05:54.627 sys 0m0.035s 00:05:54.627 15:06:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.627 15:06:58 -- common/autotest_common.sh@10 -- # set +x 00:05:54.627 ************************************ 00:05:54.627 END TEST skip_rpc_with_delay 00:05:54.627 ************************************ 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@77 -- # uname 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:05:54.627 15:06:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.627 15:06:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.627 15:06:58 -- common/autotest_common.sh@10 -- # set +x 00:05:54.627 ************************************ 00:05:54.627 START TEST exit_on_failed_rpc_init 00:05:54.627 ************************************ 00:05:54.627 15:06:58 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=491625 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@63 -- # waitforlisten 491625 00:05:54.627 15:06:58 -- common/autotest_common.sh@817 -- # '[' -z 491625 ']' 00:05:54.627 15:06:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.627 15:06:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:54.627 15:06:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.627 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.627 15:06:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:54.627 15:06:58 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:54.627 15:06:58 -- common/autotest_common.sh@10 -- # set +x 00:05:54.887 [2024-04-24 15:06:58.575737] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:54.887 [2024-04-24 15:06:58.575790] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid491625 ] 00:05:54.887 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.887 [2024-04-24 15:06:58.654804] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.887 [2024-04-24 15:06:58.737262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.457 15:06:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:55.457 15:06:59 -- common/autotest_common.sh@850 -- # return 0 00:05:55.457 15:06:59 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:55.457 15:06:59 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:55.457 15:06:59 -- common/autotest_common.sh@638 -- # local es=0 00:05:55.457 15:06:59 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:55.457 15:06:59 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:55.457 15:06:59 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:55.457 15:06:59 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:55.457 15:06:59 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:55.457 15:06:59 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:55.457 15:06:59 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:55.457 15:06:59 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:05:55.457 15:06:59 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:55.457 15:06:59 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:55.717 [2024-04-24 15:06:59.392395] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:55.717 [2024-04-24 15:06:59.392454] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid491799 ] 00:05:55.717 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.717 [2024-04-24 15:06:59.471153] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.717 [2024-04-24 15:06:59.549855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.717 [2024-04-24 15:06:59.549930] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:05:55.717 [2024-04-24 15:06:59.549941] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:05:55.717 [2024-04-24 15:06:59.549949] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:55.976 15:06:59 -- common/autotest_common.sh@641 -- # es=234 00:05:55.976 15:06:59 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:55.976 15:06:59 -- common/autotest_common.sh@650 -- # es=106 00:05:55.976 15:06:59 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:55.976 15:06:59 -- common/autotest_common.sh@658 -- # es=1 00:05:55.976 15:06:59 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:55.976 15:06:59 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:05:55.976 15:06:59 -- rpc/skip_rpc.sh@70 -- # killprocess 491625 00:05:55.976 15:06:59 -- common/autotest_common.sh@936 -- # '[' -z 491625 ']' 00:05:55.976 15:06:59 -- common/autotest_common.sh@940 -- # kill -0 491625 00:05:55.976 15:06:59 -- common/autotest_common.sh@941 -- # uname 00:05:55.976 15:06:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.977 15:06:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 491625 00:05:55.977 15:06:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.977 15:06:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.977 15:06:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 491625' 00:05:55.977 killing process with pid 491625 00:05:55.977 15:06:59 -- common/autotest_common.sh@955 -- # kill 491625 00:05:55.977 15:06:59 -- common/autotest_common.sh@960 -- # wait 491625 00:05:56.236 00:05:56.236 real 0m1.520s 00:05:56.236 user 0m1.674s 00:05:56.236 sys 0m0.483s 00:05:56.236 15:07:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.236 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:56.236 ************************************ 00:05:56.236 END TEST exit_on_failed_rpc_init 00:05:56.236 ************************************ 00:05:56.236 15:07:00 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc/config.json 00:05:56.236 00:05:56.236 real 0m14.686s 00:05:56.236 user 0m13.747s 00:05:56.236 sys 0m1.971s 00:05:56.236 15:07:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.236 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:56.236 ************************************ 00:05:56.236 END TEST skip_rpc 00:05:56.236 ************************************ 00:05:56.236 15:07:00 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:56.236 15:07:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.236 15:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.236 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:56.497 ************************************ 00:05:56.497 START TEST rpc_client 00:05:56.497 ************************************ 00:05:56.497 15:07:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:56.497 * Looking for test storage... 00:05:56.497 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client 00:05:56.497 15:07:00 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:56.756 OK 00:05:56.756 15:07:00 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:56.756 00:05:56.756 real 0m0.140s 00:05:56.756 user 0m0.060s 00:05:56.756 sys 0m0.091s 00:05:56.756 15:07:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.756 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:56.756 ************************************ 00:05:56.756 END TEST rpc_client 00:05:56.756 ************************************ 00:05:56.756 15:07:00 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config.sh 00:05:56.756 15:07:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.756 15:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.756 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:56.756 ************************************ 00:05:56.756 START TEST json_config 00:05:56.756 ************************************ 00:05:56.756 15:07:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config.sh 00:05:57.016 15:07:00 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:05:57.016 15:07:00 -- nvmf/common.sh@7 -- # uname -s 00:05:57.016 15:07:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:57.016 15:07:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:57.016 15:07:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:57.017 15:07:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:57.017 15:07:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:57.017 15:07:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:57.017 15:07:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:57.017 15:07:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:57.017 15:07:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:57.017 15:07:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:57.017 15:07:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:05:57.017 15:07:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:05:57.017 15:07:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:57.017 15:07:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:57.017 15:07:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:57.017 15:07:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:57.017 15:07:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:05:57.017 15:07:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:57.017 15:07:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:57.017 15:07:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:57.017 15:07:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:57.017 15:07:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:57.017 15:07:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:57.017 15:07:00 -- paths/export.sh@5 -- # export PATH 00:05:57.017 15:07:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:57.017 15:07:00 -- nvmf/common.sh@47 -- # : 0 00:05:57.017 15:07:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:57.017 15:07:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:57.017 15:07:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:57.017 15:07:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:57.017 15:07:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:57.017 15:07:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:57.017 15:07:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:57.017 15:07:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:57.017 15:07:00 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/common.sh 00:05:57.017 15:07:00 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:05:57.017 15:07:00 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:05:57.017 15:07:00 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:05:57.017 15:07:00 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:57.017 15:07:00 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:05:57.017 15:07:00 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:05:57.017 15:07:00 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:57.017 15:07:00 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:05:57.017 15:07:00 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:57.017 15:07:00 -- json_config/json_config.sh@33 -- # declare -A app_params 00:05:57.017 15:07:00 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_initiator_config.json') 00:05:57.017 15:07:00 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:05:57.017 15:07:00 -- json_config/json_config.sh@40 -- # last_event_id=0 00:05:57.017 15:07:00 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:57.017 15:07:00 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:05:57.017 INFO: JSON configuration test init 00:05:57.017 15:07:00 -- json_config/json_config.sh@357 -- # json_config_test_init 00:05:57.017 15:07:00 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:05:57.017 15:07:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:57.017 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:57.017 15:07:00 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:05:57.017 15:07:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:57.017 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:57.017 15:07:00 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:05:57.017 15:07:00 -- json_config/common.sh@9 -- # local app=target 00:05:57.017 15:07:00 -- json_config/common.sh@10 -- # shift 00:05:57.017 15:07:00 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:57.017 15:07:00 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:57.017 15:07:00 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:57.017 15:07:00 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:57.017 15:07:00 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:57.017 15:07:00 -- json_config/common.sh@22 -- # app_pid["$app"]=492099 00:05:57.017 15:07:00 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:57.017 Waiting for target to run... 00:05:57.017 15:07:00 -- json_config/common.sh@25 -- # waitforlisten 492099 /var/tmp/spdk_tgt.sock 00:05:57.017 15:07:00 -- common/autotest_common.sh@817 -- # '[' -z 492099 ']' 00:05:57.017 15:07:00 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:57.017 15:07:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:57.017 15:07:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:57.017 15:07:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:57.017 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:57.017 15:07:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:57.017 15:07:00 -- common/autotest_common.sh@10 -- # set +x 00:05:57.017 [2024-04-24 15:07:00.764304] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:05:57.017 [2024-04-24 15:07:00.764366] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid492099 ] 00:05:57.017 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.276 [2024-04-24 15:07:01.057558] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.276 [2024-04-24 15:07:01.125420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.846 15:07:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:57.846 15:07:01 -- common/autotest_common.sh@850 -- # return 0 00:05:57.846 15:07:01 -- json_config/common.sh@26 -- # echo '' 00:05:57.846 00:05:57.846 15:07:01 -- json_config/json_config.sh@269 -- # create_accel_config 00:05:57.846 15:07:01 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:05:57.846 15:07:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:57.846 15:07:01 -- common/autotest_common.sh@10 -- # set +x 00:05:57.846 15:07:01 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:05:57.846 15:07:01 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:05:57.846 15:07:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:57.846 15:07:01 -- common/autotest_common.sh@10 -- # set +x 00:05:57.846 15:07:01 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:57.846 15:07:01 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:05:57.846 15:07:01 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:01.143 15:07:04 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:06:01.143 15:07:04 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:01.143 15:07:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:01.143 15:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.143 15:07:04 -- json_config/json_config.sh@45 -- # local ret=0 00:06:01.143 15:07:04 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:01.143 15:07:04 -- json_config/json_config.sh@46 -- # local enabled_types 00:06:01.143 15:07:04 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:06:01.143 15:07:04 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:01.143 15:07:04 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:06:01.143 15:07:04 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:01.143 15:07:04 -- json_config/json_config.sh@48 -- # local get_types 00:06:01.143 15:07:04 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:06:01.143 15:07:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:01.143 15:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.143 15:07:04 -- json_config/json_config.sh@55 -- # return 0 00:06:01.143 15:07:04 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:06:01.143 15:07:04 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:06:01.143 15:07:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:01.143 15:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:01.143 15:07:04 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:01.143 15:07:04 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:06:01.143 15:07:04 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:06:01.143 15:07:04 -- json_config/json_config.sh@234 -- # nvmftestinit 00:06:01.143 15:07:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:01.143 15:07:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:01.143 15:07:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:01.143 15:07:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:01.143 15:07:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:01.143 15:07:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:01.143 15:07:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:06:01.143 15:07:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:01.143 15:07:04 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:06:01.143 15:07:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:01.143 15:07:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:01.143 15:07:04 -- common/autotest_common.sh@10 -- # set +x 00:06:09.271 15:07:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:09.271 15:07:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:09.271 15:07:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:09.271 15:07:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:09.271 15:07:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:09.271 15:07:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:09.271 15:07:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:09.271 15:07:12 -- nvmf/common.sh@295 -- # net_devs=() 00:06:09.271 15:07:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:09.271 15:07:12 -- nvmf/common.sh@296 -- # e810=() 00:06:09.271 15:07:12 -- nvmf/common.sh@296 -- # local -ga e810 00:06:09.271 15:07:12 -- nvmf/common.sh@297 -- # x722=() 00:06:09.271 15:07:12 -- nvmf/common.sh@297 -- # local -ga x722 00:06:09.271 15:07:12 -- nvmf/common.sh@298 -- # mlx=() 00:06:09.271 15:07:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:09.271 15:07:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:09.271 15:07:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:09.271 15:07:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:09.271 15:07:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:09.271 15:07:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:09.271 15:07:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:06:09.271 15:07:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:06:09.272 15:07:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:06:09.272 Found 0000:18:00.0 (0x8086 - 0x1592) 00:06:09.272 15:07:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:09.272 15:07:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:06:09.272 Found 0000:18:00.1 (0x8086 - 0x1592) 00:06:09.272 15:07:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:09.272 15:07:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@375 -- # (( 0 != 1 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@375 -- # modprobe -r irdma 00:06:09.272 15:07:12 -- nvmf/common.sh@377 -- # modinfo irdma 00:06:09.272 15:07:12 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:06:09.272 15:07:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:09.272 15:07:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:09.272 15:07:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:06:09.272 Found net devices under 0000:18:00.0: cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:09.272 15:07:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:09.272 15:07:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:09.272 15:07:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:06:09.272 Found net devices under 0000:18:00.1: cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:09.272 15:07:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:09.272 15:07:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:09.272 15:07:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:09.272 15:07:12 -- nvmf/common.sh@58 -- # uname 00:06:09.272 15:07:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:09.272 15:07:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:09.272 15:07:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:09.272 15:07:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:09.272 15:07:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:09.272 15:07:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:09.272 15:07:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:09.272 15:07:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:09.272 15:07:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:09.272 15:07:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:09.272 15:07:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:09.272 15:07:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:09.272 15:07:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:09.272 15:07:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:09.272 15:07:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:09.272 15:07:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@105 -- # continue 2 00:06:09.272 15:07:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@105 -- # continue 2 00:06:09.272 15:07:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:09.272 15:07:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:09.272 15:07:12 -- nvmf/common.sh@74 -- # ip= 00:06:09.272 15:07:12 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@77 -- # ip link set cvl_0_0 up 00:06:09.272 15:07:12 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:06:09.272 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:09.272 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:06:09.272 altname enp24s0f0np0 00:06:09.272 altname ens785f0np0 00:06:09.272 inet 192.168.100.8/24 scope global cvl_0_0 00:06:09.272 valid_lft forever preferred_lft forever 00:06:09.272 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:06:09.272 valid_lft forever preferred_lft forever 00:06:09.272 15:07:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:09.272 15:07:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:09.272 15:07:12 -- nvmf/common.sh@74 -- # ip= 00:06:09.272 15:07:12 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@77 -- # ip link set cvl_0_1 up 00:06:09.272 15:07:12 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:06:09.272 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:06:09.272 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:06:09.272 altname enp24s0f1np1 00:06:09.272 altname ens785f1np1 00:06:09.272 inet 192.168.100.9/24 scope global cvl_0_1 00:06:09.272 valid_lft forever preferred_lft forever 00:06:09.272 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:06:09.272 valid_lft forever preferred_lft forever 00:06:09.272 15:07:12 -- nvmf/common.sh@411 -- # return 0 00:06:09.272 15:07:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:09.272 15:07:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:09.272 15:07:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:09.272 15:07:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:09.272 15:07:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:09.272 15:07:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:09.272 15:07:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:09.272 15:07:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:09.272 15:07:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:09.272 15:07:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@105 -- # continue 2 00:06:09.272 15:07:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:09.272 15:07:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:06:09.272 15:07:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@105 -- # continue 2 00:06:09.272 15:07:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:09.272 15:07:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:09.272 15:07:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:09.272 15:07:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:09.272 15:07:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:09.272 15:07:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:09.272 192.168.100.9' 00:06:09.273 15:07:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:09.273 192.168.100.9' 00:06:09.273 15:07:12 -- nvmf/common.sh@446 -- # head -n 1 00:06:09.273 15:07:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:09.273 15:07:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:09.273 192.168.100.9' 00:06:09.273 15:07:12 -- nvmf/common.sh@447 -- # tail -n +2 00:06:09.273 15:07:12 -- nvmf/common.sh@447 -- # head -n 1 00:06:09.273 15:07:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:09.273 15:07:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:09.273 15:07:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:09.273 15:07:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:09.273 15:07:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:09.273 15:07:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:09.273 15:07:12 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:06:09.273 15:07:12 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:09.273 15:07:12 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:09.273 MallocForNvmf0 00:06:09.273 15:07:13 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:09.273 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:09.273 MallocForNvmf1 00:06:09.532 15:07:13 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:06:09.532 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:06:09.532 [2024-04-24 15:07:13.342181] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:09.532 [2024-04-24 15:07:13.375630] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1e38b50/0x1e38190) succeed. 00:06:09.532 [2024-04-24 15:07:13.387296] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1e3ac90/0x1e38710) succeed. 00:06:09.532 [2024-04-24 15:07:13.387317] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:06:09.532 [2024-04-24 15:07:13.389445] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/3071 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:06:09.532 [2024-04-24 15:07:13.389459] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:06:09.532 [2024-04-24 15:07:13.391119] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:06:09.532 15:07:13 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:09.532 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:09.792 15:07:13 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:09.792 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:10.050 15:07:13 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:10.050 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:10.050 15:07:13 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:10.050 15:07:13 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:10.308 [2024-04-24 15:07:14.089219] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:10.308 15:07:14 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:06:10.308 15:07:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:10.308 15:07:14 -- common/autotest_common.sh@10 -- # set +x 00:06:10.308 15:07:14 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:06:10.308 15:07:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:10.308 15:07:14 -- common/autotest_common.sh@10 -- # set +x 00:06:10.308 15:07:14 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:06:10.308 15:07:14 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:10.308 15:07:14 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:10.567 MallocBdevForConfigChangeCheck 00:06:10.567 15:07:14 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:06:10.567 15:07:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:10.567 15:07:14 -- common/autotest_common.sh@10 -- # set +x 00:06:10.567 15:07:14 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:06:10.567 15:07:14 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:10.827 15:07:14 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:06:10.827 INFO: shutting down applications... 00:06:10.827 15:07:14 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:06:10.827 15:07:14 -- json_config/json_config.sh@368 -- # json_config_clear target 00:06:10.827 15:07:14 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:06:10.827 15:07:14 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:15.025 Calling clear_iscsi_subsystem 00:06:15.025 Calling clear_nvmf_subsystem 00:06:15.025 Calling clear_nbd_subsystem 00:06:15.025 Calling clear_ublk_subsystem 00:06:15.025 Calling clear_vhost_blk_subsystem 00:06:15.025 Calling clear_vhost_scsi_subsystem 00:06:15.025 Calling clear_bdev_subsystem 00:06:15.025 15:07:18 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py 00:06:15.025 15:07:18 -- json_config/json_config.sh@343 -- # count=100 00:06:15.025 15:07:18 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:06:15.025 15:07:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:15.025 15:07:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:15.025 15:07:18 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:15.025 15:07:18 -- json_config/json_config.sh@345 -- # break 00:06:15.025 15:07:18 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:06:15.025 15:07:18 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:06:15.025 15:07:18 -- json_config/common.sh@31 -- # local app=target 00:06:15.025 15:07:18 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:15.025 15:07:18 -- json_config/common.sh@35 -- # [[ -n 492099 ]] 00:06:15.025 15:07:18 -- json_config/common.sh@38 -- # kill -SIGINT 492099 00:06:15.025 15:07:18 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:15.025 15:07:18 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:15.025 15:07:18 -- json_config/common.sh@41 -- # kill -0 492099 00:06:15.025 15:07:18 -- json_config/common.sh@45 -- # sleep 0.5 00:06:15.285 [2024-04-24 15:07:19.022453] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:15.546 15:07:19 -- json_config/common.sh@40 -- # (( i++ )) 00:06:15.546 15:07:19 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:15.546 15:07:19 -- json_config/common.sh@41 -- # kill -0 492099 00:06:15.546 15:07:19 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:15.546 15:07:19 -- json_config/common.sh@43 -- # break 00:06:15.546 15:07:19 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:15.546 15:07:19 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:15.546 SPDK target shutdown done 00:06:15.546 15:07:19 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:06:15.546 INFO: relaunching applications... 00:06:15.546 15:07:19 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:15.546 15:07:19 -- json_config/common.sh@9 -- # local app=target 00:06:15.546 15:07:19 -- json_config/common.sh@10 -- # shift 00:06:15.546 15:07:19 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:15.546 15:07:19 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:15.546 15:07:19 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:15.546 15:07:19 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:15.546 15:07:19 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:15.546 15:07:19 -- json_config/common.sh@22 -- # app_pid["$app"]=496968 00:06:15.546 15:07:19 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:15.546 Waiting for target to run... 00:06:15.546 15:07:19 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:15.546 15:07:19 -- json_config/common.sh@25 -- # waitforlisten 496968 /var/tmp/spdk_tgt.sock 00:06:15.546 15:07:19 -- common/autotest_common.sh@817 -- # '[' -z 496968 ']' 00:06:15.546 15:07:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:15.546 15:07:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:15.546 15:07:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:15.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:15.546 15:07:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:15.546 15:07:19 -- common/autotest_common.sh@10 -- # set +x 00:06:15.805 [2024-04-24 15:07:19.487747] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:15.806 [2024-04-24 15:07:19.487809] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid496968 ] 00:06:15.806 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.374 [2024-04-24 15:07:19.982159] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.374 [2024-04-24 15:07:20.061345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.667 [2024-04-24 15:07:23.078029] transport.c: 288:nvmf_transport_create: *WARNING*: The num_shared_buffers value (4095) is larger than the available iobuf pool size (1024). Please increase the iobuf pool sizes. 00:06:19.667 [2024-04-24 15:07:23.094630] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1072760/0x1071da0) succeed. 00:06:19.667 [2024-04-24 15:07:23.105081] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x10748a0/0x1072320) succeed. 00:06:19.667 [2024-04-24 15:07:23.107291] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/3071 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:06:19.667 [2024-04-24 15:07:23.107309] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:06:19.667 [2024-04-24 15:07:23.108922] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:06:19.667 [2024-04-24 15:07:23.137159] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:19.926 15:07:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:19.926 15:07:23 -- common/autotest_common.sh@850 -- # return 0 00:06:19.926 15:07:23 -- json_config/common.sh@26 -- # echo '' 00:06:19.926 00:06:19.926 15:07:23 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:06:19.926 15:07:23 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:19.926 INFO: Checking if target configuration is the same... 00:06:19.926 15:07:23 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:06:19.926 15:07:23 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:19.926 15:07:23 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:19.926 + '[' 2 -ne 2 ']' 00:06:19.926 +++ dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:19.926 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/../.. 00:06:19.926 + rootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:06:19.926 +++ basename /dev/fd/62 00:06:19.926 ++ mktemp /tmp/62.XXX 00:06:19.926 + tmp_file_1=/tmp/62.RaI 00:06:19.926 +++ basename /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:19.926 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:19.926 + tmp_file_2=/tmp/spdk_tgt_config.json.UTy 00:06:19.926 + ret=0 00:06:19.926 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:20.185 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:20.185 + diff -u /tmp/62.RaI /tmp/spdk_tgt_config.json.UTy 00:06:20.185 + echo 'INFO: JSON config files are the same' 00:06:20.185 INFO: JSON config files are the same 00:06:20.185 + rm /tmp/62.RaI /tmp/spdk_tgt_config.json.UTy 00:06:20.185 + exit 0 00:06:20.185 15:07:24 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:06:20.185 15:07:24 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:20.185 INFO: changing configuration and checking if this can be detected... 00:06:20.185 15:07:24 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:20.185 15:07:24 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:20.446 15:07:24 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:20.446 15:07:24 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:06:20.446 15:07:24 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:20.446 + '[' 2 -ne 2 ']' 00:06:20.446 +++ dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:20.446 ++ readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/../.. 00:06:20.446 + rootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:06:20.446 +++ basename /dev/fd/62 00:06:20.446 ++ mktemp /tmp/62.XXX 00:06:20.446 + tmp_file_1=/tmp/62.iRe 00:06:20.446 +++ basename /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:20.446 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:20.446 + tmp_file_2=/tmp/spdk_tgt_config.json.qUJ 00:06:20.446 + ret=0 00:06:20.446 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:20.704 + /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:20.705 + diff -u /tmp/62.iRe /tmp/spdk_tgt_config.json.qUJ 00:06:20.705 + ret=1 00:06:20.705 + echo '=== Start of file: /tmp/62.iRe ===' 00:06:20.705 + cat /tmp/62.iRe 00:06:20.705 + echo '=== End of file: /tmp/62.iRe ===' 00:06:20.705 + echo '' 00:06:20.705 + echo '=== Start of file: /tmp/spdk_tgt_config.json.qUJ ===' 00:06:20.705 + cat /tmp/spdk_tgt_config.json.qUJ 00:06:20.705 + echo '=== End of file: /tmp/spdk_tgt_config.json.qUJ ===' 00:06:20.705 + echo '' 00:06:20.705 + rm /tmp/62.iRe /tmp/spdk_tgt_config.json.qUJ 00:06:20.705 + exit 1 00:06:20.705 15:07:24 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:06:20.705 INFO: configuration change detected. 00:06:20.705 15:07:24 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:06:20.705 15:07:24 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:06:20.705 15:07:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:20.705 15:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.705 15:07:24 -- json_config/json_config.sh@307 -- # local ret=0 00:06:20.705 15:07:24 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:06:20.705 15:07:24 -- json_config/json_config.sh@317 -- # [[ -n 496968 ]] 00:06:20.705 15:07:24 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:06:20.705 15:07:24 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:06:20.705 15:07:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:20.705 15:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.705 15:07:24 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:06:20.705 15:07:24 -- json_config/json_config.sh@193 -- # uname -s 00:06:20.705 15:07:24 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:06:20.705 15:07:24 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:06:20.705 15:07:24 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:06:20.705 15:07:24 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:06:20.705 15:07:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:20.705 15:07:24 -- common/autotest_common.sh@10 -- # set +x 00:06:20.705 15:07:24 -- json_config/json_config.sh@323 -- # killprocess 496968 00:06:20.705 15:07:24 -- common/autotest_common.sh@936 -- # '[' -z 496968 ']' 00:06:20.705 15:07:24 -- common/autotest_common.sh@940 -- # kill -0 496968 00:06:20.705 15:07:24 -- common/autotest_common.sh@941 -- # uname 00:06:20.705 15:07:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:20.964 15:07:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 496968 00:06:20.964 15:07:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.964 15:07:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.964 15:07:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 496968' 00:06:20.964 killing process with pid 496968 00:06:20.964 15:07:24 -- common/autotest_common.sh@955 -- # kill 496968 00:06:20.964 15:07:24 -- common/autotest_common.sh@960 -- # wait 496968 00:06:20.964 [2024-04-24 15:07:24.757475] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:25.185 15:07:28 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/spdk_tgt_config.json 00:06:25.185 15:07:28 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:06:25.185 15:07:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:25.185 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.185 15:07:28 -- json_config/json_config.sh@328 -- # return 0 00:06:25.185 15:07:28 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:06:25.185 INFO: Success 00:06:25.185 15:07:28 -- json_config/json_config.sh@1 -- # nvmftestfini 00:06:25.185 15:07:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:25.185 15:07:28 -- nvmf/common.sh@117 -- # sync 00:06:25.185 15:07:28 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:06:25.185 15:07:28 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:06:25.185 15:07:28 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:06:25.185 15:07:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:25.185 15:07:28 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:06:25.185 00:06:25.185 real 0m27.997s 00:06:25.185 user 0m30.549s 00:06:25.185 sys 0m8.327s 00:06:25.185 15:07:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.185 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.185 ************************************ 00:06:25.185 END TEST json_config 00:06:25.185 ************************************ 00:06:25.185 15:07:28 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:25.185 15:07:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.185 15:07:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.185 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.185 ************************************ 00:06:25.185 START TEST json_config_extra_key 00:06:25.185 ************************************ 00:06:25.185 15:07:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:25.185 15:07:28 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:06:25.185 15:07:28 -- nvmf/common.sh@7 -- # uname -s 00:06:25.185 15:07:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:25.185 15:07:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:25.185 15:07:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:25.185 15:07:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:25.185 15:07:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:25.185 15:07:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:25.185 15:07:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:25.185 15:07:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:25.185 15:07:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:25.185 15:07:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:25.185 15:07:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:06:25.185 15:07:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:06:25.185 15:07:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:25.185 15:07:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:25.185 15:07:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:25.185 15:07:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:25.185 15:07:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:06:25.185 15:07:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:25.185 15:07:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:25.185 15:07:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:25.185 15:07:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.185 15:07:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.186 15:07:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.186 15:07:28 -- paths/export.sh@5 -- # export PATH 00:06:25.186 15:07:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.186 15:07:28 -- nvmf/common.sh@47 -- # : 0 00:06:25.186 15:07:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:25.186 15:07:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:25.186 15:07:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:25.186 15:07:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:25.186 15:07:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:25.186 15:07:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:25.186 15:07:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:25.186 15:07:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/common.sh 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:06:25.186 INFO: launching applications... 00:06:25.186 15:07:28 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json 00:06:25.186 15:07:28 -- json_config/common.sh@9 -- # local app=target 00:06:25.186 15:07:28 -- json_config/common.sh@10 -- # shift 00:06:25.186 15:07:28 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:25.186 15:07:28 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:25.186 15:07:28 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:25.186 15:07:28 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:25.186 15:07:28 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:25.186 15:07:28 -- json_config/common.sh@22 -- # app_pid["$app"]=498319 00:06:25.186 15:07:28 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:25.186 Waiting for target to run... 00:06:25.186 15:07:28 -- json_config/common.sh@25 -- # waitforlisten 498319 /var/tmp/spdk_tgt.sock 00:06:25.186 15:07:28 -- common/autotest_common.sh@817 -- # '[' -z 498319 ']' 00:06:25.186 15:07:28 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/extra_key.json 00:06:25.186 15:07:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:25.186 15:07:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:25.186 15:07:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:25.186 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:25.186 15:07:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:25.186 15:07:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.186 [2024-04-24 15:07:28.968180] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:25.186 [2024-04-24 15:07:28.968245] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid498319 ] 00:06:25.186 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.755 [2024-04-24 15:07:29.484360] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.755 [2024-04-24 15:07:29.566580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.014 15:07:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:26.014 15:07:29 -- common/autotest_common.sh@850 -- # return 0 00:06:26.014 15:07:29 -- json_config/common.sh@26 -- # echo '' 00:06:26.014 00:06:26.014 15:07:29 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:06:26.014 INFO: shutting down applications... 00:06:26.014 15:07:29 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:06:26.014 15:07:29 -- json_config/common.sh@31 -- # local app=target 00:06:26.014 15:07:29 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:26.014 15:07:29 -- json_config/common.sh@35 -- # [[ -n 498319 ]] 00:06:26.014 15:07:29 -- json_config/common.sh@38 -- # kill -SIGINT 498319 00:06:26.014 15:07:29 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:26.014 15:07:29 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:26.014 15:07:29 -- json_config/common.sh@41 -- # kill -0 498319 00:06:26.014 15:07:29 -- json_config/common.sh@45 -- # sleep 0.5 00:06:26.586 15:07:30 -- json_config/common.sh@40 -- # (( i++ )) 00:06:26.586 15:07:30 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:26.586 15:07:30 -- json_config/common.sh@41 -- # kill -0 498319 00:06:26.586 15:07:30 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:26.586 15:07:30 -- json_config/common.sh@43 -- # break 00:06:26.586 15:07:30 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:26.586 15:07:30 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:26.586 SPDK target shutdown done 00:06:26.586 15:07:30 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:06:26.586 Success 00:06:26.586 00:06:26.586 real 0m1.472s 00:06:26.586 user 0m1.042s 00:06:26.586 sys 0m0.630s 00:06:26.586 15:07:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:26.586 15:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.586 ************************************ 00:06:26.586 END TEST json_config_extra_key 00:06:26.586 ************************************ 00:06:26.586 15:07:30 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:26.586 15:07:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.586 15:07:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.586 15:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.586 ************************************ 00:06:26.586 START TEST alias_rpc 00:06:26.586 ************************************ 00:06:26.586 15:07:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:26.846 * Looking for test storage... 00:06:26.846 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/alias_rpc 00:06:26.846 15:07:30 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:26.846 15:07:30 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=498580 00:06:26.846 15:07:30 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 498580 00:06:26.846 15:07:30 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:06:26.846 15:07:30 -- common/autotest_common.sh@817 -- # '[' -z 498580 ']' 00:06:26.846 15:07:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.846 15:07:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:26.846 15:07:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.846 15:07:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:26.846 15:07:30 -- common/autotest_common.sh@10 -- # set +x 00:06:26.846 [2024-04-24 15:07:30.603681] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:26.846 [2024-04-24 15:07:30.603740] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid498580 ] 00:06:26.846 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.846 [2024-04-24 15:07:30.686550] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.106 [2024-04-24 15:07:30.766126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.677 15:07:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:27.677 15:07:31 -- common/autotest_common.sh@850 -- # return 0 00:06:27.677 15:07:31 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:27.936 15:07:31 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 498580 00:06:27.936 15:07:31 -- common/autotest_common.sh@936 -- # '[' -z 498580 ']' 00:06:27.936 15:07:31 -- common/autotest_common.sh@940 -- # kill -0 498580 00:06:27.936 15:07:31 -- common/autotest_common.sh@941 -- # uname 00:06:27.936 15:07:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.936 15:07:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 498580 00:06:27.936 15:07:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.936 15:07:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.936 15:07:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 498580' 00:06:27.936 killing process with pid 498580 00:06:27.936 15:07:31 -- common/autotest_common.sh@955 -- # kill 498580 00:06:27.936 15:07:31 -- common/autotest_common.sh@960 -- # wait 498580 00:06:28.196 00:06:28.196 real 0m1.566s 00:06:28.196 user 0m1.610s 00:06:28.196 sys 0m0.505s 00:06:28.196 15:07:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:28.196 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:28.196 ************************************ 00:06:28.196 END TEST alias_rpc 00:06:28.196 ************************************ 00:06:28.196 15:07:32 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:06:28.196 15:07:32 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:28.196 15:07:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:28.196 15:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.196 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:28.456 ************************************ 00:06:28.456 START TEST spdkcli_tcp 00:06:28.456 ************************************ 00:06:28.456 15:07:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:28.456 * Looking for test storage... 00:06:28.456 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/common.sh 00:06:28.456 15:07:32 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:28.456 15:07:32 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:28.456 15:07:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:28.456 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=498965 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@27 -- # waitforlisten 498965 00:06:28.456 15:07:32 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:28.456 15:07:32 -- common/autotest_common.sh@817 -- # '[' -z 498965 ']' 00:06:28.456 15:07:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.456 15:07:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:28.456 15:07:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.456 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.456 15:07:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:28.456 15:07:32 -- common/autotest_common.sh@10 -- # set +x 00:06:28.456 [2024-04-24 15:07:32.358264] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:28.457 [2024-04-24 15:07:32.358321] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid498965 ] 00:06:28.717 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.717 [2024-04-24 15:07:32.437111] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:28.717 [2024-04-24 15:07:32.513881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.717 [2024-04-24 15:07:32.513884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.286 15:07:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:29.286 15:07:33 -- common/autotest_common.sh@850 -- # return 0 00:06:29.286 15:07:33 -- spdkcli/tcp.sh@31 -- # socat_pid=498987 00:06:29.286 15:07:33 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:29.286 15:07:33 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:29.547 [ 00:06:29.547 "bdev_malloc_delete", 00:06:29.547 "bdev_malloc_create", 00:06:29.547 "bdev_null_resize", 00:06:29.547 "bdev_null_delete", 00:06:29.547 "bdev_null_create", 00:06:29.547 "bdev_nvme_cuse_unregister", 00:06:29.547 "bdev_nvme_cuse_register", 00:06:29.547 "bdev_opal_new_user", 00:06:29.547 "bdev_opal_set_lock_state", 00:06:29.547 "bdev_opal_delete", 00:06:29.547 "bdev_opal_get_info", 00:06:29.547 "bdev_opal_create", 00:06:29.547 "bdev_nvme_opal_revert", 00:06:29.547 "bdev_nvme_opal_init", 00:06:29.547 "bdev_nvme_send_cmd", 00:06:29.547 "bdev_nvme_get_path_iostat", 00:06:29.547 "bdev_nvme_get_mdns_discovery_info", 00:06:29.547 "bdev_nvme_stop_mdns_discovery", 00:06:29.547 "bdev_nvme_start_mdns_discovery", 00:06:29.547 "bdev_nvme_set_multipath_policy", 00:06:29.547 "bdev_nvme_set_preferred_path", 00:06:29.547 "bdev_nvme_get_io_paths", 00:06:29.547 "bdev_nvme_remove_error_injection", 00:06:29.547 "bdev_nvme_add_error_injection", 00:06:29.547 "bdev_nvme_get_discovery_info", 00:06:29.547 "bdev_nvme_stop_discovery", 00:06:29.547 "bdev_nvme_start_discovery", 00:06:29.547 "bdev_nvme_get_controller_health_info", 00:06:29.547 "bdev_nvme_disable_controller", 00:06:29.547 "bdev_nvme_enable_controller", 00:06:29.547 "bdev_nvme_reset_controller", 00:06:29.547 "bdev_nvme_get_transport_statistics", 00:06:29.547 "bdev_nvme_apply_firmware", 00:06:29.547 "bdev_nvme_detach_controller", 00:06:29.547 "bdev_nvme_get_controllers", 00:06:29.547 "bdev_nvme_attach_controller", 00:06:29.547 "bdev_nvme_set_hotplug", 00:06:29.547 "bdev_nvme_set_options", 00:06:29.547 "bdev_passthru_delete", 00:06:29.547 "bdev_passthru_create", 00:06:29.547 "bdev_lvol_grow_lvstore", 00:06:29.547 "bdev_lvol_get_lvols", 00:06:29.547 "bdev_lvol_get_lvstores", 00:06:29.547 "bdev_lvol_delete", 00:06:29.547 "bdev_lvol_set_read_only", 00:06:29.547 "bdev_lvol_resize", 00:06:29.547 "bdev_lvol_decouple_parent", 00:06:29.547 "bdev_lvol_inflate", 00:06:29.547 "bdev_lvol_rename", 00:06:29.547 "bdev_lvol_clone_bdev", 00:06:29.547 "bdev_lvol_clone", 00:06:29.547 "bdev_lvol_snapshot", 00:06:29.547 "bdev_lvol_create", 00:06:29.547 "bdev_lvol_delete_lvstore", 00:06:29.547 "bdev_lvol_rename_lvstore", 00:06:29.547 "bdev_lvol_create_lvstore", 00:06:29.547 "bdev_raid_set_options", 00:06:29.547 "bdev_raid_remove_base_bdev", 00:06:29.547 "bdev_raid_add_base_bdev", 00:06:29.547 "bdev_raid_delete", 00:06:29.547 "bdev_raid_create", 00:06:29.547 "bdev_raid_get_bdevs", 00:06:29.547 "bdev_error_inject_error", 00:06:29.547 "bdev_error_delete", 00:06:29.547 "bdev_error_create", 00:06:29.547 "bdev_split_delete", 00:06:29.547 "bdev_split_create", 00:06:29.547 "bdev_delay_delete", 00:06:29.547 "bdev_delay_create", 00:06:29.547 "bdev_delay_update_latency", 00:06:29.547 "bdev_zone_block_delete", 00:06:29.547 "bdev_zone_block_create", 00:06:29.547 "blobfs_create", 00:06:29.547 "blobfs_detect", 00:06:29.547 "blobfs_set_cache_size", 00:06:29.547 "bdev_aio_delete", 00:06:29.547 "bdev_aio_rescan", 00:06:29.547 "bdev_aio_create", 00:06:29.547 "bdev_ftl_set_property", 00:06:29.547 "bdev_ftl_get_properties", 00:06:29.547 "bdev_ftl_get_stats", 00:06:29.547 "bdev_ftl_unmap", 00:06:29.547 "bdev_ftl_unload", 00:06:29.547 "bdev_ftl_delete", 00:06:29.547 "bdev_ftl_load", 00:06:29.547 "bdev_ftl_create", 00:06:29.547 "bdev_virtio_attach_controller", 00:06:29.547 "bdev_virtio_scsi_get_devices", 00:06:29.547 "bdev_virtio_detach_controller", 00:06:29.547 "bdev_virtio_blk_set_hotplug", 00:06:29.547 "bdev_iscsi_delete", 00:06:29.547 "bdev_iscsi_create", 00:06:29.547 "bdev_iscsi_set_options", 00:06:29.547 "accel_error_inject_error", 00:06:29.547 "ioat_scan_accel_module", 00:06:29.547 "dsa_scan_accel_module", 00:06:29.547 "iaa_scan_accel_module", 00:06:29.547 "keyring_file_remove_key", 00:06:29.547 "keyring_file_add_key", 00:06:29.547 "iscsi_get_histogram", 00:06:29.547 "iscsi_enable_histogram", 00:06:29.547 "iscsi_set_options", 00:06:29.547 "iscsi_get_auth_groups", 00:06:29.547 "iscsi_auth_group_remove_secret", 00:06:29.547 "iscsi_auth_group_add_secret", 00:06:29.547 "iscsi_delete_auth_group", 00:06:29.547 "iscsi_create_auth_group", 00:06:29.547 "iscsi_set_discovery_auth", 00:06:29.547 "iscsi_get_options", 00:06:29.547 "iscsi_target_node_request_logout", 00:06:29.547 "iscsi_target_node_set_redirect", 00:06:29.547 "iscsi_target_node_set_auth", 00:06:29.547 "iscsi_target_node_add_lun", 00:06:29.547 "iscsi_get_stats", 00:06:29.547 "iscsi_get_connections", 00:06:29.547 "iscsi_portal_group_set_auth", 00:06:29.547 "iscsi_start_portal_group", 00:06:29.547 "iscsi_delete_portal_group", 00:06:29.547 "iscsi_create_portal_group", 00:06:29.547 "iscsi_get_portal_groups", 00:06:29.547 "iscsi_delete_target_node", 00:06:29.547 "iscsi_target_node_remove_pg_ig_maps", 00:06:29.547 "iscsi_target_node_add_pg_ig_maps", 00:06:29.547 "iscsi_create_target_node", 00:06:29.547 "iscsi_get_target_nodes", 00:06:29.547 "iscsi_delete_initiator_group", 00:06:29.547 "iscsi_initiator_group_remove_initiators", 00:06:29.547 "iscsi_initiator_group_add_initiators", 00:06:29.547 "iscsi_create_initiator_group", 00:06:29.547 "iscsi_get_initiator_groups", 00:06:29.547 "nvmf_set_crdt", 00:06:29.547 "nvmf_set_config", 00:06:29.547 "nvmf_set_max_subsystems", 00:06:29.547 "nvmf_subsystem_get_listeners", 00:06:29.547 "nvmf_subsystem_get_qpairs", 00:06:29.547 "nvmf_subsystem_get_controllers", 00:06:29.548 "nvmf_get_stats", 00:06:29.548 "nvmf_get_transports", 00:06:29.548 "nvmf_create_transport", 00:06:29.548 "nvmf_get_targets", 00:06:29.548 "nvmf_delete_target", 00:06:29.548 "nvmf_create_target", 00:06:29.548 "nvmf_subsystem_allow_any_host", 00:06:29.548 "nvmf_subsystem_remove_host", 00:06:29.548 "nvmf_subsystem_add_host", 00:06:29.548 "nvmf_ns_remove_host", 00:06:29.548 "nvmf_ns_add_host", 00:06:29.548 "nvmf_subsystem_remove_ns", 00:06:29.548 "nvmf_subsystem_add_ns", 00:06:29.548 "nvmf_subsystem_listener_set_ana_state", 00:06:29.548 "nvmf_discovery_get_referrals", 00:06:29.548 "nvmf_discovery_remove_referral", 00:06:29.548 "nvmf_discovery_add_referral", 00:06:29.548 "nvmf_subsystem_remove_listener", 00:06:29.548 "nvmf_subsystem_add_listener", 00:06:29.548 "nvmf_delete_subsystem", 00:06:29.548 "nvmf_create_subsystem", 00:06:29.548 "nvmf_get_subsystems", 00:06:29.548 "env_dpdk_get_mem_stats", 00:06:29.548 "nbd_get_disks", 00:06:29.548 "nbd_stop_disk", 00:06:29.548 "nbd_start_disk", 00:06:29.548 "ublk_recover_disk", 00:06:29.548 "ublk_get_disks", 00:06:29.548 "ublk_stop_disk", 00:06:29.548 "ublk_start_disk", 00:06:29.548 "ublk_destroy_target", 00:06:29.548 "ublk_create_target", 00:06:29.548 "virtio_blk_create_transport", 00:06:29.548 "virtio_blk_get_transports", 00:06:29.548 "vhost_controller_set_coalescing", 00:06:29.548 "vhost_get_controllers", 00:06:29.548 "vhost_delete_controller", 00:06:29.548 "vhost_create_blk_controller", 00:06:29.548 "vhost_scsi_controller_remove_target", 00:06:29.548 "vhost_scsi_controller_add_target", 00:06:29.548 "vhost_start_scsi_controller", 00:06:29.548 "vhost_create_scsi_controller", 00:06:29.548 "thread_set_cpumask", 00:06:29.548 "framework_get_scheduler", 00:06:29.548 "framework_set_scheduler", 00:06:29.548 "framework_get_reactors", 00:06:29.548 "thread_get_io_channels", 00:06:29.548 "thread_get_pollers", 00:06:29.548 "thread_get_stats", 00:06:29.548 "framework_monitor_context_switch", 00:06:29.548 "spdk_kill_instance", 00:06:29.548 "log_enable_timestamps", 00:06:29.548 "log_get_flags", 00:06:29.548 "log_clear_flag", 00:06:29.548 "log_set_flag", 00:06:29.548 "log_get_level", 00:06:29.548 "log_set_level", 00:06:29.548 "log_get_print_level", 00:06:29.548 "log_set_print_level", 00:06:29.548 "framework_enable_cpumask_locks", 00:06:29.548 "framework_disable_cpumask_locks", 00:06:29.548 "framework_wait_init", 00:06:29.548 "framework_start_init", 00:06:29.548 "scsi_get_devices", 00:06:29.548 "bdev_get_histogram", 00:06:29.548 "bdev_enable_histogram", 00:06:29.548 "bdev_set_qos_limit", 00:06:29.548 "bdev_set_qd_sampling_period", 00:06:29.548 "bdev_get_bdevs", 00:06:29.548 "bdev_reset_iostat", 00:06:29.548 "bdev_get_iostat", 00:06:29.548 "bdev_examine", 00:06:29.548 "bdev_wait_for_examine", 00:06:29.548 "bdev_set_options", 00:06:29.548 "notify_get_notifications", 00:06:29.548 "notify_get_types", 00:06:29.548 "accel_get_stats", 00:06:29.548 "accel_set_options", 00:06:29.548 "accel_set_driver", 00:06:29.548 "accel_crypto_key_destroy", 00:06:29.548 "accel_crypto_keys_get", 00:06:29.548 "accel_crypto_key_create", 00:06:29.548 "accel_assign_opc", 00:06:29.548 "accel_get_module_info", 00:06:29.548 "accel_get_opc_assignments", 00:06:29.548 "vmd_rescan", 00:06:29.548 "vmd_remove_device", 00:06:29.548 "vmd_enable", 00:06:29.548 "sock_set_default_impl", 00:06:29.548 "sock_impl_set_options", 00:06:29.548 "sock_impl_get_options", 00:06:29.548 "iobuf_get_stats", 00:06:29.548 "iobuf_set_options", 00:06:29.548 "framework_get_pci_devices", 00:06:29.548 "framework_get_config", 00:06:29.548 "framework_get_subsystems", 00:06:29.548 "trace_get_info", 00:06:29.548 "trace_get_tpoint_group_mask", 00:06:29.548 "trace_disable_tpoint_group", 00:06:29.548 "trace_enable_tpoint_group", 00:06:29.548 "trace_clear_tpoint_mask", 00:06:29.548 "trace_set_tpoint_mask", 00:06:29.548 "keyring_get_keys", 00:06:29.548 "spdk_get_version", 00:06:29.548 "rpc_get_methods" 00:06:29.548 ] 00:06:29.548 15:07:33 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:29.548 15:07:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:29.548 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:29.548 15:07:33 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:29.548 15:07:33 -- spdkcli/tcp.sh@38 -- # killprocess 498965 00:06:29.548 15:07:33 -- common/autotest_common.sh@936 -- # '[' -z 498965 ']' 00:06:29.548 15:07:33 -- common/autotest_common.sh@940 -- # kill -0 498965 00:06:29.548 15:07:33 -- common/autotest_common.sh@941 -- # uname 00:06:29.548 15:07:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.548 15:07:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 498965 00:06:29.548 15:07:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.548 15:07:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.548 15:07:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 498965' 00:06:29.548 killing process with pid 498965 00:06:29.548 15:07:33 -- common/autotest_common.sh@955 -- # kill 498965 00:06:29.548 15:07:33 -- common/autotest_common.sh@960 -- # wait 498965 00:06:30.118 00:06:30.118 real 0m1.592s 00:06:30.118 user 0m2.830s 00:06:30.118 sys 0m0.518s 00:06:30.118 15:07:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:30.118 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:30.118 ************************************ 00:06:30.118 END TEST spdkcli_tcp 00:06:30.118 ************************************ 00:06:30.118 15:07:33 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:30.118 15:07:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:30.118 15:07:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.118 15:07:33 -- common/autotest_common.sh@10 -- # set +x 00:06:30.118 ************************************ 00:06:30.118 START TEST dpdk_mem_utility 00:06:30.118 ************************************ 00:06:30.118 15:07:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:30.377 * Looking for test storage... 00:06:30.377 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dpdk_memory_utility 00:06:30.377 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:30.377 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=499226 00:06:30.377 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 499226 00:06:30.377 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt 00:06:30.377 15:07:34 -- common/autotest_common.sh@817 -- # '[' -z 499226 ']' 00:06:30.377 15:07:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.377 15:07:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:30.377 15:07:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.377 15:07:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:30.377 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:30.377 [2024-04-24 15:07:34.127983] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:30.377 [2024-04-24 15:07:34.128046] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid499226 ] 00:06:30.377 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.377 [2024-04-24 15:07:34.209223] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.637 [2024-04-24 15:07:34.291550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.207 15:07:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:31.207 15:07:34 -- common/autotest_common.sh@850 -- # return 0 00:06:31.207 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:31.207 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:31.207 15:07:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:31.207 15:07:34 -- common/autotest_common.sh@10 -- # set +x 00:06:31.207 { 00:06:31.207 "filename": "/tmp/spdk_mem_dump.txt" 00:06:31.207 } 00:06:31.207 15:07:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:31.207 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:31.207 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:31.207 1 heaps totaling size 814.000000 MiB 00:06:31.207 size: 814.000000 MiB heap id: 0 00:06:31.207 end heaps---------- 00:06:31.207 8 mempools totaling size 598.116089 MiB 00:06:31.207 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:31.207 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:31.207 size: 84.521057 MiB name: bdev_io_499226 00:06:31.207 size: 51.011292 MiB name: evtpool_499226 00:06:31.207 size: 50.003479 MiB name: msgpool_499226 00:06:31.207 size: 21.763794 MiB name: PDU_Pool 00:06:31.207 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:31.207 size: 0.026123 MiB name: Session_Pool 00:06:31.207 end mempools------- 00:06:31.207 6 memzones totaling size 4.142822 MiB 00:06:31.207 size: 1.000366 MiB name: RG_ring_0_499226 00:06:31.207 size: 1.000366 MiB name: RG_ring_1_499226 00:06:31.207 size: 1.000366 MiB name: RG_ring_4_499226 00:06:31.207 size: 1.000366 MiB name: RG_ring_5_499226 00:06:31.207 size: 0.125366 MiB name: RG_ring_2_499226 00:06:31.207 size: 0.015991 MiB name: RG_ring_3_499226 00:06:31.207 end memzones------- 00:06:31.207 15:07:34 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:31.207 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:31.207 list of free elements. size: 12.519348 MiB 00:06:31.207 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:31.207 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:31.207 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:31.207 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:31.207 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:31.207 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:31.207 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:31.207 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:31.207 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:31.207 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:31.207 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:31.207 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:31.207 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:31.207 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:31.207 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:31.207 list of standard malloc elements. size: 199.218079 MiB 00:06:31.207 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:31.207 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:31.207 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:31.207 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:31.207 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:31.207 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:31.207 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:31.207 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:31.207 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:31.207 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:31.207 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:31.208 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:31.208 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:31.208 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:31.208 list of memzone associated elements. size: 602.262573 MiB 00:06:31.208 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:31.208 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:31.208 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:31.208 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:31.208 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:31.208 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_499226_0 00:06:31.208 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:31.208 associated memzone info: size: 48.002930 MiB name: MP_evtpool_499226_0 00:06:31.208 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:31.208 associated memzone info: size: 48.002930 MiB name: MP_msgpool_499226_0 00:06:31.208 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:31.208 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:31.208 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:31.208 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:31.208 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:31.208 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_499226 00:06:31.208 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:31.208 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_499226 00:06:31.208 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:31.208 associated memzone info: size: 1.007996 MiB name: MP_evtpool_499226 00:06:31.208 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:31.208 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:31.208 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:31.208 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:31.208 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:31.208 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:31.208 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:31.208 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:31.208 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:31.208 associated memzone info: size: 1.000366 MiB name: RG_ring_0_499226 00:06:31.208 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:31.208 associated memzone info: size: 1.000366 MiB name: RG_ring_1_499226 00:06:31.208 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:31.208 associated memzone info: size: 1.000366 MiB name: RG_ring_4_499226 00:06:31.208 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:31.208 associated memzone info: size: 1.000366 MiB name: RG_ring_5_499226 00:06:31.208 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:31.208 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_499226 00:06:31.208 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:31.208 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:31.208 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:31.208 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:31.208 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:31.208 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:31.208 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:31.208 associated memzone info: size: 0.125366 MiB name: RG_ring_2_499226 00:06:31.208 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:31.208 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:31.208 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:31.208 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:31.208 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:31.208 associated memzone info: size: 0.015991 MiB name: RG_ring_3_499226 00:06:31.208 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:31.208 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:31.208 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:31.208 associated memzone info: size: 0.000183 MiB name: MP_msgpool_499226 00:06:31.208 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:31.208 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_499226 00:06:31.208 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:31.208 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:31.208 15:07:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:31.208 15:07:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 499226 00:06:31.208 15:07:35 -- common/autotest_common.sh@936 -- # '[' -z 499226 ']' 00:06:31.208 15:07:35 -- common/autotest_common.sh@940 -- # kill -0 499226 00:06:31.208 15:07:35 -- common/autotest_common.sh@941 -- # uname 00:06:31.208 15:07:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.208 15:07:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 499226 00:06:31.208 15:07:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.208 15:07:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.208 15:07:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 499226' 00:06:31.208 killing process with pid 499226 00:06:31.208 15:07:35 -- common/autotest_common.sh@955 -- # kill 499226 00:06:31.208 15:07:35 -- common/autotest_common.sh@960 -- # wait 499226 00:06:31.778 00:06:31.778 real 0m1.464s 00:06:31.778 user 0m1.477s 00:06:31.778 sys 0m0.462s 00:06:31.778 15:07:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:31.778 15:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:31.778 ************************************ 00:06:31.778 END TEST dpdk_mem_utility 00:06:31.778 ************************************ 00:06:31.778 15:07:35 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event.sh 00:06:31.778 15:07:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.778 15:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.778 15:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:31.778 ************************************ 00:06:31.778 START TEST event 00:06:31.778 ************************************ 00:06:31.778 15:07:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event.sh 00:06:32.039 * Looking for test storage... 00:06:32.039 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event 00:06:32.039 15:07:35 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:32.039 15:07:35 -- bdev/nbd_common.sh@6 -- # set -e 00:06:32.039 15:07:35 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:32.039 15:07:35 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:32.039 15:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.039 15:07:35 -- common/autotest_common.sh@10 -- # set +x 00:06:32.039 ************************************ 00:06:32.039 START TEST event_perf 00:06:32.039 ************************************ 00:06:32.039 15:07:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:32.039 Running I/O for 1 seconds...[2024-04-24 15:07:35.916529] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:32.039 [2024-04-24 15:07:35.916594] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid499519 ] 00:06:32.299 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.299 [2024-04-24 15:07:35.997188] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:32.299 [2024-04-24 15:07:36.078840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:32.299 [2024-04-24 15:07:36.078900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:32.299 [2024-04-24 15:07:36.078978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:32.299 [2024-04-24 15:07:36.078979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.683 Running I/O for 1 seconds... 00:06:33.683 lcore 0: 205666 00:06:33.683 lcore 1: 205663 00:06:33.683 lcore 2: 205664 00:06:33.683 lcore 3: 205664 00:06:33.683 done. 00:06:33.683 00:06:33.683 real 0m1.278s 00:06:33.683 user 0m4.168s 00:06:33.683 sys 0m0.108s 00:06:33.683 15:07:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:33.683 15:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:33.683 ************************************ 00:06:33.683 END TEST event_perf 00:06:33.683 ************************************ 00:06:33.683 15:07:37 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:33.683 15:07:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:33.683 15:07:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.683 15:07:37 -- common/autotest_common.sh@10 -- # set +x 00:06:33.683 ************************************ 00:06:33.683 START TEST event_reactor 00:06:33.683 ************************************ 00:06:33.683 15:07:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:33.683 [2024-04-24 15:07:37.384934] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:33.683 [2024-04-24 15:07:37.385000] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid499782 ] 00:06:33.683 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.683 [2024-04-24 15:07:37.467885] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.683 [2024-04-24 15:07:37.547803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.129 test_start 00:06:35.129 oneshot 00:06:35.129 tick 100 00:06:35.129 tick 100 00:06:35.129 tick 250 00:06:35.129 tick 100 00:06:35.129 tick 100 00:06:35.129 tick 100 00:06:35.129 tick 250 00:06:35.129 tick 500 00:06:35.129 tick 100 00:06:35.129 tick 100 00:06:35.129 tick 250 00:06:35.129 tick 100 00:06:35.129 tick 100 00:06:35.129 test_end 00:06:35.129 00:06:35.129 real 0m1.283s 00:06:35.129 user 0m1.181s 00:06:35.129 sys 0m0.098s 00:06:35.129 15:07:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:35.129 15:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:35.129 ************************************ 00:06:35.129 END TEST event_reactor 00:06:35.129 ************************************ 00:06:35.129 15:07:38 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:35.129 15:07:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:35.129 15:07:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.129 15:07:38 -- common/autotest_common.sh@10 -- # set +x 00:06:35.129 ************************************ 00:06:35.130 START TEST event_reactor_perf 00:06:35.130 ************************************ 00:06:35.130 15:07:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:35.130 [2024-04-24 15:07:38.842400] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:35.130 [2024-04-24 15:07:38.842477] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid500048 ] 00:06:35.130 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.130 [2024-04-24 15:07:38.930533] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.130 [2024-04-24 15:07:39.006141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.536 test_start 00:06:36.536 test_end 00:06:36.536 Performance: 515976 events per second 00:06:36.536 00:06:36.536 real 0m1.286s 00:06:36.536 user 0m1.183s 00:06:36.536 sys 0m0.098s 00:06:36.536 15:07:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:36.536 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:36.536 ************************************ 00:06:36.536 END TEST event_reactor_perf 00:06:36.536 ************************************ 00:06:36.536 15:07:40 -- event/event.sh@49 -- # uname -s 00:06:36.536 15:07:40 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:36.536 15:07:40 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:36.536 15:07:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.536 15:07:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.536 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:36.536 ************************************ 00:06:36.536 START TEST event_scheduler 00:06:36.536 ************************************ 00:06:36.536 15:07:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:36.536 * Looking for test storage... 00:06:36.536 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler 00:06:36.536 15:07:40 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:36.536 15:07:40 -- scheduler/scheduler.sh@35 -- # scheduler_pid=500286 00:06:36.536 15:07:40 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:36.536 15:07:40 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:36.536 15:07:40 -- scheduler/scheduler.sh@37 -- # waitforlisten 500286 00:06:36.536 15:07:40 -- common/autotest_common.sh@817 -- # '[' -z 500286 ']' 00:06:36.536 15:07:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.536 15:07:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:36.536 15:07:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.536 15:07:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:36.536 15:07:40 -- common/autotest_common.sh@10 -- # set +x 00:06:36.818 [2024-04-24 15:07:40.454598] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:36.818 [2024-04-24 15:07:40.454658] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid500286 ] 00:06:36.818 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.818 [2024-04-24 15:07:40.543353] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:36.818 [2024-04-24 15:07:40.631891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.818 [2024-04-24 15:07:40.631968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:36.818 [2024-04-24 15:07:40.632042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:36.818 [2024-04-24 15:07:40.632043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:37.409 15:07:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:37.409 15:07:41 -- common/autotest_common.sh@850 -- # return 0 00:06:37.409 15:07:41 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:37.409 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.409 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.409 POWER: Env isn't set yet! 00:06:37.409 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:37.409 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:06:37.409 POWER: Cannot set governor of lcore 0 to userspace 00:06:37.409 POWER: Attempting to initialise PSTAT power management... 00:06:37.409 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:37.409 POWER: Initialized successfully for lcore 0 power management 00:06:37.685 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:37.685 POWER: Initialized successfully for lcore 1 power management 00:06:37.685 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:37.685 POWER: Initialized successfully for lcore 2 power management 00:06:37.685 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:37.685 POWER: Initialized successfully for lcore 3 power management 00:06:37.685 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.685 15:07:41 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:37.685 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.685 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.685 [2024-04-24 15:07:41.425636] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:37.685 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.685 15:07:41 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:37.685 15:07:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.685 15:07:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.685 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.685 ************************************ 00:06:37.685 START TEST scheduler_create_thread 00:06:37.685 ************************************ 00:06:37.685 15:07:41 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:06:37.685 15:07:41 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 2 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 3 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 4 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 5 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 6 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 7 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 8 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 9 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 10 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:37.971 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.971 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:37.971 15:07:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:37.971 15:07:41 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:37.972 15:07:41 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:37.972 15:07:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:37.972 15:07:41 -- common/autotest_common.sh@10 -- # set +x 00:06:38.590 15:07:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:38.590 15:07:42 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:38.591 15:07:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:38.591 15:07:42 -- common/autotest_common.sh@10 -- # set +x 00:06:40.039 15:07:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:40.039 15:07:43 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:40.039 15:07:43 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:40.039 15:07:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:40.039 15:07:43 -- common/autotest_common.sh@10 -- # set +x 00:06:41.037 15:07:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:41.037 00:06:41.037 real 0m3.099s 00:06:41.037 user 0m0.018s 00:06:41.037 sys 0m0.012s 00:06:41.037 15:07:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:41.037 15:07:44 -- common/autotest_common.sh@10 -- # set +x 00:06:41.037 ************************************ 00:06:41.037 END TEST scheduler_create_thread 00:06:41.037 ************************************ 00:06:41.037 15:07:44 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:41.037 15:07:44 -- scheduler/scheduler.sh@46 -- # killprocess 500286 00:06:41.037 15:07:44 -- common/autotest_common.sh@936 -- # '[' -z 500286 ']' 00:06:41.037 15:07:44 -- common/autotest_common.sh@940 -- # kill -0 500286 00:06:41.037 15:07:44 -- common/autotest_common.sh@941 -- # uname 00:06:41.037 15:07:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.037 15:07:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 500286 00:06:41.037 15:07:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:41.037 15:07:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:41.037 15:07:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 500286' 00:06:41.037 killing process with pid 500286 00:06:41.037 15:07:44 -- common/autotest_common.sh@955 -- # kill 500286 00:06:41.037 15:07:44 -- common/autotest_common.sh@960 -- # wait 500286 00:06:41.356 [2024-04-24 15:07:45.069378] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:41.356 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:06:41.356 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:41.356 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:06:41.356 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:41.356 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:06:41.356 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:41.356 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:06:41.356 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:41.651 00:06:41.651 real 0m5.029s 00:06:41.651 user 0m9.659s 00:06:41.651 sys 0m0.561s 00:06:41.651 15:07:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:41.651 15:07:45 -- common/autotest_common.sh@10 -- # set +x 00:06:41.651 ************************************ 00:06:41.651 END TEST event_scheduler 00:06:41.651 ************************************ 00:06:41.651 15:07:45 -- event/event.sh@51 -- # modprobe -n nbd 00:06:41.651 15:07:45 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:41.651 15:07:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.651 15:07:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.651 15:07:45 -- common/autotest_common.sh@10 -- # set +x 00:06:41.651 ************************************ 00:06:41.651 START TEST app_repeat 00:06:41.651 ************************************ 00:06:41.651 15:07:45 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:06:41.651 15:07:45 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:41.651 15:07:45 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:41.651 15:07:45 -- event/event.sh@13 -- # local nbd_list 00:06:41.651 15:07:45 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:41.651 15:07:45 -- event/event.sh@14 -- # local bdev_list 00:06:41.651 15:07:45 -- event/event.sh@15 -- # local repeat_times=4 00:06:41.651 15:07:45 -- event/event.sh@17 -- # modprobe nbd 00:06:41.651 15:07:45 -- event/event.sh@19 -- # repeat_pid=501073 00:06:41.651 15:07:45 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:41.651 15:07:45 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:41.651 15:07:45 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 501073' 00:06:41.651 Process app_repeat pid: 501073 00:06:41.651 15:07:45 -- event/event.sh@23 -- # for i in {0..2} 00:06:41.651 15:07:45 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:41.651 spdk_app_start Round 0 00:06:41.651 15:07:45 -- event/event.sh@25 -- # waitforlisten 501073 /var/tmp/spdk-nbd.sock 00:06:41.651 15:07:45 -- common/autotest_common.sh@817 -- # '[' -z 501073 ']' 00:06:41.651 15:07:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:41.651 15:07:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:41.651 15:07:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:41.651 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:41.651 15:07:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:41.651 15:07:45 -- common/autotest_common.sh@10 -- # set +x 00:06:41.911 [2024-04-24 15:07:45.579480] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:41.911 [2024-04-24 15:07:45.579550] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid501073 ] 00:06:41.911 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.911 [2024-04-24 15:07:45.653191] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:41.911 [2024-04-24 15:07:45.732156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.911 [2024-04-24 15:07:45.732158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.848 15:07:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:42.848 15:07:46 -- common/autotest_common.sh@850 -- # return 0 00:06:42.849 15:07:46 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:42.849 Malloc0 00:06:42.849 15:07:46 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:42.849 Malloc1 00:06:43.108 15:07:46 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@12 -- # local i 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:43.108 /dev/nbd0 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:43.108 15:07:46 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:43.108 15:07:46 -- common/autotest_common.sh@855 -- # local i 00:06:43.108 15:07:46 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:43.108 15:07:46 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:43.108 15:07:46 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:43.108 15:07:46 -- common/autotest_common.sh@859 -- # break 00:06:43.108 15:07:46 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:43.108 15:07:46 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:43.108 15:07:46 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:43.108 1+0 records in 00:06:43.108 1+0 records out 00:06:43.108 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000206598 s, 19.8 MB/s 00:06:43.108 15:07:46 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:43.108 15:07:46 -- common/autotest_common.sh@872 -- # size=4096 00:06:43.108 15:07:46 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:43.108 15:07:46 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:43.108 15:07:46 -- common/autotest_common.sh@875 -- # return 0 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.108 15:07:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:43.367 /dev/nbd1 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:43.367 15:07:47 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:43.367 15:07:47 -- common/autotest_common.sh@855 -- # local i 00:06:43.367 15:07:47 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:43.367 15:07:47 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:43.367 15:07:47 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:43.367 15:07:47 -- common/autotest_common.sh@859 -- # break 00:06:43.367 15:07:47 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:43.367 15:07:47 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:43.367 15:07:47 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:43.367 1+0 records in 00:06:43.367 1+0 records out 00:06:43.367 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000224558 s, 18.2 MB/s 00:06:43.367 15:07:47 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:43.367 15:07:47 -- common/autotest_common.sh@872 -- # size=4096 00:06:43.367 15:07:47 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:43.367 15:07:47 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:43.367 15:07:47 -- common/autotest_common.sh@875 -- # return 0 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.367 15:07:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:43.626 { 00:06:43.626 "nbd_device": "/dev/nbd0", 00:06:43.626 "bdev_name": "Malloc0" 00:06:43.626 }, 00:06:43.626 { 00:06:43.626 "nbd_device": "/dev/nbd1", 00:06:43.626 "bdev_name": "Malloc1" 00:06:43.626 } 00:06:43.626 ]' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:43.626 { 00:06:43.626 "nbd_device": "/dev/nbd0", 00:06:43.626 "bdev_name": "Malloc0" 00:06:43.626 }, 00:06:43.626 { 00:06:43.626 "nbd_device": "/dev/nbd1", 00:06:43.626 "bdev_name": "Malloc1" 00:06:43.626 } 00:06:43.626 ]' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:43.626 /dev/nbd1' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:43.626 /dev/nbd1' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@65 -- # count=2 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@95 -- # count=2 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:43.626 256+0 records in 00:06:43.626 256+0 records out 00:06:43.626 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107014 s, 98.0 MB/s 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:43.626 256+0 records in 00:06:43.626 256+0 records out 00:06:43.626 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185502 s, 56.5 MB/s 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:43.626 256+0 records in 00:06:43.626 256+0 records out 00:06:43.626 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211599 s, 49.6 MB/s 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:43.626 15:07:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@51 -- # local i 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:43.627 15:07:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@41 -- # break 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:43.886 15:07:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@41 -- # break 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:44.146 15:07:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:44.146 15:07:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:44.146 15:07:48 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:44.146 15:07:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@65 -- # true 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@65 -- # count=0 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:44.405 15:07:48 -- bdev/nbd_common.sh@104 -- # count=0 00:06:44.406 15:07:48 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:44.406 15:07:48 -- bdev/nbd_common.sh@109 -- # return 0 00:06:44.406 15:07:48 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:44.406 15:07:48 -- event/event.sh@35 -- # sleep 3 00:06:44.665 [2024-04-24 15:07:48.518405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:44.924 [2024-04-24 15:07:48.602611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:44.924 [2024-04-24 15:07:48.602613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.924 [2024-04-24 15:07:48.650969] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:44.924 [2024-04-24 15:07:48.651027] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:47.460 15:07:51 -- event/event.sh@23 -- # for i in {0..2} 00:06:47.460 15:07:51 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:47.460 spdk_app_start Round 1 00:06:47.460 15:07:51 -- event/event.sh@25 -- # waitforlisten 501073 /var/tmp/spdk-nbd.sock 00:06:47.460 15:07:51 -- common/autotest_common.sh@817 -- # '[' -z 501073 ']' 00:06:47.460 15:07:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:47.460 15:07:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:47.460 15:07:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:47.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:47.460 15:07:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:47.460 15:07:51 -- common/autotest_common.sh@10 -- # set +x 00:06:47.719 15:07:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:47.719 15:07:51 -- common/autotest_common.sh@850 -- # return 0 00:06:47.719 15:07:51 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:47.978 Malloc0 00:06:47.978 15:07:51 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:47.978 Malloc1 00:06:47.978 15:07:51 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@12 -- # local i 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:47.978 15:07:51 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:48.237 /dev/nbd0 00:06:48.237 15:07:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:48.237 15:07:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:48.237 15:07:52 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:48.237 15:07:52 -- common/autotest_common.sh@855 -- # local i 00:06:48.237 15:07:52 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:48.237 15:07:52 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:48.237 15:07:52 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:48.237 15:07:52 -- common/autotest_common.sh@859 -- # break 00:06:48.237 15:07:52 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:48.237 15:07:52 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:48.237 15:07:52 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:48.237 1+0 records in 00:06:48.237 1+0 records out 00:06:48.237 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000265381 s, 15.4 MB/s 00:06:48.237 15:07:52 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:48.237 15:07:52 -- common/autotest_common.sh@872 -- # size=4096 00:06:48.237 15:07:52 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:48.237 15:07:52 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:48.237 15:07:52 -- common/autotest_common.sh@875 -- # return 0 00:06:48.237 15:07:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:48.237 15:07:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:48.237 15:07:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:48.496 /dev/nbd1 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:48.496 15:07:52 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:48.496 15:07:52 -- common/autotest_common.sh@855 -- # local i 00:06:48.496 15:07:52 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:48.496 15:07:52 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:48.496 15:07:52 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:48.496 15:07:52 -- common/autotest_common.sh@859 -- # break 00:06:48.496 15:07:52 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:48.496 15:07:52 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:48.496 15:07:52 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:48.496 1+0 records in 00:06:48.496 1+0 records out 00:06:48.496 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000139524 s, 29.4 MB/s 00:06:48.496 15:07:52 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:48.496 15:07:52 -- common/autotest_common.sh@872 -- # size=4096 00:06:48.496 15:07:52 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:48.496 15:07:52 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:48.496 15:07:52 -- common/autotest_common.sh@875 -- # return 0 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:48.496 15:07:52 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:48.496 { 00:06:48.496 "nbd_device": "/dev/nbd0", 00:06:48.496 "bdev_name": "Malloc0" 00:06:48.496 }, 00:06:48.496 { 00:06:48.496 "nbd_device": "/dev/nbd1", 00:06:48.496 "bdev_name": "Malloc1" 00:06:48.496 } 00:06:48.496 ]' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:48.756 { 00:06:48.756 "nbd_device": "/dev/nbd0", 00:06:48.756 "bdev_name": "Malloc0" 00:06:48.756 }, 00:06:48.756 { 00:06:48.756 "nbd_device": "/dev/nbd1", 00:06:48.756 "bdev_name": "Malloc1" 00:06:48.756 } 00:06:48.756 ]' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:48.756 /dev/nbd1' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:48.756 /dev/nbd1' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@65 -- # count=2 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@95 -- # count=2 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:48.756 256+0 records in 00:06:48.756 256+0 records out 00:06:48.756 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106485 s, 98.5 MB/s 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:48.756 256+0 records in 00:06:48.756 256+0 records out 00:06:48.756 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205253 s, 51.1 MB/s 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:48.756 256+0 records in 00:06:48.756 256+0 records out 00:06:48.756 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213305 s, 49.2 MB/s 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@51 -- # local i 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:48.756 15:07:52 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:49.026 15:07:52 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:49.026 15:07:52 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:49.026 15:07:52 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@41 -- # break 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@45 -- # return 0 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:49.027 15:07:52 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@41 -- # break 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@45 -- # return 0 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:49.287 15:07:52 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@65 -- # true 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@65 -- # count=0 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@104 -- # count=0 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:49.287 15:07:53 -- bdev/nbd_common.sh@109 -- # return 0 00:06:49.287 15:07:53 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:49.545 15:07:53 -- event/event.sh@35 -- # sleep 3 00:06:49.804 [2024-04-24 15:07:53.572573] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:49.804 [2024-04-24 15:07:53.648447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:49.804 [2024-04-24 15:07:53.648449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.804 [2024-04-24 15:07:53.697376] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:49.804 [2024-04-24 15:07:53.697424] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:53.092 15:07:56 -- event/event.sh@23 -- # for i in {0..2} 00:06:53.092 15:07:56 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:53.092 spdk_app_start Round 2 00:06:53.092 15:07:56 -- event/event.sh@25 -- # waitforlisten 501073 /var/tmp/spdk-nbd.sock 00:06:53.092 15:07:56 -- common/autotest_common.sh@817 -- # '[' -z 501073 ']' 00:06:53.092 15:07:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:53.092 15:07:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:53.092 15:07:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:53.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:53.092 15:07:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:53.092 15:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:53.092 15:07:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:53.092 15:07:56 -- common/autotest_common.sh@850 -- # return 0 00:06:53.092 15:07:56 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:53.092 Malloc0 00:06:53.092 15:07:56 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:53.092 Malloc1 00:06:53.092 15:07:56 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@12 -- # local i 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:53.092 15:07:56 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:53.351 /dev/nbd0 00:06:53.351 15:07:57 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:53.351 15:07:57 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:53.351 15:07:57 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:53.351 15:07:57 -- common/autotest_common.sh@855 -- # local i 00:06:53.351 15:07:57 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:53.351 15:07:57 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:53.351 15:07:57 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:53.351 15:07:57 -- common/autotest_common.sh@859 -- # break 00:06:53.351 15:07:57 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:53.351 15:07:57 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:53.351 15:07:57 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:53.351 1+0 records in 00:06:53.351 1+0 records out 00:06:53.351 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000228028 s, 18.0 MB/s 00:06:53.351 15:07:57 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:53.351 15:07:57 -- common/autotest_common.sh@872 -- # size=4096 00:06:53.351 15:07:57 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:53.351 15:07:57 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:53.351 15:07:57 -- common/autotest_common.sh@875 -- # return 0 00:06:53.351 15:07:57 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:53.351 15:07:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:53.351 15:07:57 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:53.610 /dev/nbd1 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:53.610 15:07:57 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:53.610 15:07:57 -- common/autotest_common.sh@855 -- # local i 00:06:53.610 15:07:57 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:53.610 15:07:57 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:53.610 15:07:57 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:53.610 15:07:57 -- common/autotest_common.sh@859 -- # break 00:06:53.610 15:07:57 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:53.610 15:07:57 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:53.610 15:07:57 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:53.610 1+0 records in 00:06:53.610 1+0 records out 00:06:53.610 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000261852 s, 15.6 MB/s 00:06:53.610 15:07:57 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:53.610 15:07:57 -- common/autotest_common.sh@872 -- # size=4096 00:06:53.610 15:07:57 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdtest 00:06:53.610 15:07:57 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:53.610 15:07:57 -- common/autotest_common.sh@875 -- # return 0 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:53.610 { 00:06:53.610 "nbd_device": "/dev/nbd0", 00:06:53.610 "bdev_name": "Malloc0" 00:06:53.610 }, 00:06:53.610 { 00:06:53.610 "nbd_device": "/dev/nbd1", 00:06:53.610 "bdev_name": "Malloc1" 00:06:53.610 } 00:06:53.610 ]' 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:53.610 { 00:06:53.610 "nbd_device": "/dev/nbd0", 00:06:53.610 "bdev_name": "Malloc0" 00:06:53.610 }, 00:06:53.610 { 00:06:53.610 "nbd_device": "/dev/nbd1", 00:06:53.610 "bdev_name": "Malloc1" 00:06:53.610 } 00:06:53.610 ]' 00:06:53.610 15:07:57 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:53.868 /dev/nbd1' 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:53.868 /dev/nbd1' 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@65 -- # count=2 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@95 -- # count=2 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:53.868 256+0 records in 00:06:53.868 256+0 records out 00:06:53.868 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107912 s, 97.2 MB/s 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:53.868 15:07:57 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:53.868 256+0 records in 00:06:53.868 256+0 records out 00:06:53.869 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186144 s, 56.3 MB/s 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:53.869 256+0 records in 00:06:53.869 256+0 records out 00:06:53.869 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214193 s, 49.0 MB/s 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/nbdrandtest 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@51 -- # local i 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:53.869 15:07:57 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@41 -- # break 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@45 -- # return 0 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:54.133 15:07:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@41 -- # break 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@45 -- # return 0 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:54.133 15:07:58 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@65 -- # true 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@65 -- # count=0 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@104 -- # count=0 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:54.392 15:07:58 -- bdev/nbd_common.sh@109 -- # return 0 00:06:54.392 15:07:58 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:54.651 15:07:58 -- event/event.sh@35 -- # sleep 3 00:06:54.910 [2024-04-24 15:07:58.644842] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:54.911 [2024-04-24 15:07:58.722936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:54.911 [2024-04-24 15:07:58.722938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.911 [2024-04-24 15:07:58.771296] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:54.911 [2024-04-24 15:07:58.771350] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:58.197 15:08:01 -- event/event.sh@38 -- # waitforlisten 501073 /var/tmp/spdk-nbd.sock 00:06:58.197 15:08:01 -- common/autotest_common.sh@817 -- # '[' -z 501073 ']' 00:06:58.197 15:08:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:58.197 15:08:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:58.197 15:08:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:58.197 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:58.197 15:08:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:58.197 15:08:01 -- common/autotest_common.sh@10 -- # set +x 00:06:58.197 15:08:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:58.197 15:08:01 -- common/autotest_common.sh@850 -- # return 0 00:06:58.197 15:08:01 -- event/event.sh@39 -- # killprocess 501073 00:06:58.197 15:08:01 -- common/autotest_common.sh@936 -- # '[' -z 501073 ']' 00:06:58.197 15:08:01 -- common/autotest_common.sh@940 -- # kill -0 501073 00:06:58.197 15:08:01 -- common/autotest_common.sh@941 -- # uname 00:06:58.197 15:08:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:58.197 15:08:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 501073 00:06:58.197 15:08:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:58.197 15:08:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:58.197 15:08:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 501073' 00:06:58.197 killing process with pid 501073 00:06:58.197 15:08:01 -- common/autotest_common.sh@955 -- # kill 501073 00:06:58.197 15:08:01 -- common/autotest_common.sh@960 -- # wait 501073 00:06:58.197 spdk_app_start is called in Round 0. 00:06:58.197 Shutdown signal received, stop current app iteration 00:06:58.197 Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 reinitialization... 00:06:58.197 spdk_app_start is called in Round 1. 00:06:58.197 Shutdown signal received, stop current app iteration 00:06:58.197 Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 reinitialization... 00:06:58.197 spdk_app_start is called in Round 2. 00:06:58.197 Shutdown signal received, stop current app iteration 00:06:58.197 Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 reinitialization... 00:06:58.197 spdk_app_start is called in Round 3. 00:06:58.197 Shutdown signal received, stop current app iteration 00:06:58.197 15:08:01 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:58.197 15:08:01 -- event/event.sh@42 -- # return 0 00:06:58.197 00:06:58.197 real 0m16.293s 00:06:58.197 user 0m34.436s 00:06:58.197 sys 0m3.017s 00:06:58.197 15:08:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:58.197 15:08:01 -- common/autotest_common.sh@10 -- # set +x 00:06:58.197 ************************************ 00:06:58.197 END TEST app_repeat 00:06:58.197 ************************************ 00:06:58.197 15:08:01 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:58.197 15:08:01 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:58.197 15:08:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:58.197 15:08:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.197 15:08:01 -- common/autotest_common.sh@10 -- # set +x 00:06:58.197 ************************************ 00:06:58.197 START TEST cpu_locks 00:06:58.197 ************************************ 00:06:58.197 15:08:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:58.457 * Looking for test storage... 00:06:58.457 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/event 00:06:58.457 15:08:02 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:58.457 15:08:02 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:58.457 15:08:02 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:58.457 15:08:02 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:58.457 15:08:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:58.457 15:08:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.457 15:08:02 -- common/autotest_common.sh@10 -- # set +x 00:06:58.457 ************************************ 00:06:58.457 START TEST default_locks 00:06:58.457 ************************************ 00:06:58.457 15:08:02 -- common/autotest_common.sh@1111 -- # default_locks 00:06:58.457 15:08:02 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:58.457 15:08:02 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=503427 00:06:58.457 15:08:02 -- event/cpu_locks.sh@47 -- # waitforlisten 503427 00:06:58.457 15:08:02 -- common/autotest_common.sh@817 -- # '[' -z 503427 ']' 00:06:58.457 15:08:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.457 15:08:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:58.457 15:08:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.457 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.457 15:08:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:58.457 15:08:02 -- common/autotest_common.sh@10 -- # set +x 00:06:58.457 [2024-04-24 15:08:02.339793] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:06:58.457 [2024-04-24 15:08:02.339842] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid503427 ] 00:06:58.717 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.717 [2024-04-24 15:08:02.415264] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.717 [2024-04-24 15:08:02.501175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.284 15:08:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:59.284 15:08:03 -- common/autotest_common.sh@850 -- # return 0 00:06:59.284 15:08:03 -- event/cpu_locks.sh@49 -- # locks_exist 503427 00:06:59.284 15:08:03 -- event/cpu_locks.sh@22 -- # lslocks -p 503427 00:06:59.284 15:08:03 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:59.853 lslocks: write error 00:06:59.853 15:08:03 -- event/cpu_locks.sh@50 -- # killprocess 503427 00:06:59.853 15:08:03 -- common/autotest_common.sh@936 -- # '[' -z 503427 ']' 00:06:59.853 15:08:03 -- common/autotest_common.sh@940 -- # kill -0 503427 00:06:59.853 15:08:03 -- common/autotest_common.sh@941 -- # uname 00:06:59.853 15:08:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:59.853 15:08:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 503427 00:06:59.853 15:08:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:59.853 15:08:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:59.853 15:08:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 503427' 00:06:59.853 killing process with pid 503427 00:06:59.853 15:08:03 -- common/autotest_common.sh@955 -- # kill 503427 00:06:59.854 15:08:03 -- common/autotest_common.sh@960 -- # wait 503427 00:07:00.113 15:08:03 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 503427 00:07:00.113 15:08:03 -- common/autotest_common.sh@638 -- # local es=0 00:07:00.113 15:08:03 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 503427 00:07:00.113 15:08:03 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:00.113 15:08:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:00.113 15:08:03 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:00.113 15:08:03 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:00.113 15:08:03 -- common/autotest_common.sh@641 -- # waitforlisten 503427 00:07:00.113 15:08:03 -- common/autotest_common.sh@817 -- # '[' -z 503427 ']' 00:07:00.113 15:08:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.113 15:08:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:00.113 15:08:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.113 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.113 15:08:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:00.113 15:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.113 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (503427) - No such process 00:07:00.113 ERROR: process (pid: 503427) is no longer running 00:07:00.113 15:08:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:00.113 15:08:03 -- common/autotest_common.sh@850 -- # return 1 00:07:00.113 15:08:03 -- common/autotest_common.sh@641 -- # es=1 00:07:00.113 15:08:03 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:00.113 15:08:03 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:00.113 15:08:03 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:00.113 15:08:03 -- event/cpu_locks.sh@54 -- # no_locks 00:07:00.113 15:08:03 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:00.113 15:08:03 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:00.113 15:08:03 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:00.113 00:07:00.113 real 0m1.605s 00:07:00.113 user 0m1.622s 00:07:00.113 sys 0m0.572s 00:07:00.113 15:08:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:00.113 15:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.113 ************************************ 00:07:00.113 END TEST default_locks 00:07:00.113 ************************************ 00:07:00.113 15:08:03 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:07:00.113 15:08:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:00.113 15:08:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.113 15:08:03 -- common/autotest_common.sh@10 -- # set +x 00:07:00.373 ************************************ 00:07:00.373 START TEST default_locks_via_rpc 00:07:00.373 ************************************ 00:07:00.373 15:08:04 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:07:00.373 15:08:04 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=503728 00:07:00.373 15:08:04 -- event/cpu_locks.sh@63 -- # waitforlisten 503728 00:07:00.373 15:08:04 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:00.373 15:08:04 -- common/autotest_common.sh@817 -- # '[' -z 503728 ']' 00:07:00.373 15:08:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:00.373 15:08:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:00.373 15:08:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:00.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:00.373 15:08:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:00.373 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:00.373 [2024-04-24 15:08:04.131132] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:00.373 [2024-04-24 15:08:04.131185] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid503728 ] 00:07:00.373 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.373 [2024-04-24 15:08:04.211139] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.632 [2024-04-24 15:08:04.294031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.202 15:08:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:01.202 15:08:04 -- common/autotest_common.sh@850 -- # return 0 00:07:01.202 15:08:04 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:07:01.202 15:08:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:01.202 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.202 15:08:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:01.202 15:08:04 -- event/cpu_locks.sh@67 -- # no_locks 00:07:01.202 15:08:04 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:01.202 15:08:04 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:01.202 15:08:04 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:01.202 15:08:04 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:07:01.202 15:08:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:01.202 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:07:01.202 15:08:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:01.202 15:08:04 -- event/cpu_locks.sh@71 -- # locks_exist 503728 00:07:01.202 15:08:04 -- event/cpu_locks.sh@22 -- # lslocks -p 503728 00:07:01.202 15:08:04 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:01.461 15:08:05 -- event/cpu_locks.sh@73 -- # killprocess 503728 00:07:01.461 15:08:05 -- common/autotest_common.sh@936 -- # '[' -z 503728 ']' 00:07:01.461 15:08:05 -- common/autotest_common.sh@940 -- # kill -0 503728 00:07:01.461 15:08:05 -- common/autotest_common.sh@941 -- # uname 00:07:01.721 15:08:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:01.721 15:08:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 503728 00:07:01.721 15:08:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:01.721 15:08:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:01.721 15:08:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 503728' 00:07:01.721 killing process with pid 503728 00:07:01.721 15:08:05 -- common/autotest_common.sh@955 -- # kill 503728 00:07:01.721 15:08:05 -- common/autotest_common.sh@960 -- # wait 503728 00:07:01.981 00:07:01.981 real 0m1.681s 00:07:01.981 user 0m1.713s 00:07:01.981 sys 0m0.613s 00:07:01.981 15:08:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:01.981 15:08:05 -- common/autotest_common.sh@10 -- # set +x 00:07:01.981 ************************************ 00:07:01.981 END TEST default_locks_via_rpc 00:07:01.981 ************************************ 00:07:01.981 15:08:05 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:07:01.981 15:08:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:01.981 15:08:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.981 15:08:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.241 ************************************ 00:07:02.241 START TEST non_locking_app_on_locked_coremask 00:07:02.241 ************************************ 00:07:02.241 15:08:05 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:07:02.241 15:08:05 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=504024 00:07:02.241 15:08:05 -- event/cpu_locks.sh@81 -- # waitforlisten 504024 /var/tmp/spdk.sock 00:07:02.241 15:08:05 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:02.241 15:08:05 -- common/autotest_common.sh@817 -- # '[' -z 504024 ']' 00:07:02.241 15:08:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:02.241 15:08:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:02.241 15:08:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:02.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:02.241 15:08:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:02.241 15:08:05 -- common/autotest_common.sh@10 -- # set +x 00:07:02.241 [2024-04-24 15:08:05.994835] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:02.241 [2024-04-24 15:08:05.994896] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid504024 ] 00:07:02.241 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.241 [2024-04-24 15:08:06.071657] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.501 [2024-04-24 15:08:06.156903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.100 15:08:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:03.100 15:08:06 -- common/autotest_common.sh@850 -- # return 0 00:07:03.100 15:08:06 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=504144 00:07:03.100 15:08:06 -- event/cpu_locks.sh@85 -- # waitforlisten 504144 /var/tmp/spdk2.sock 00:07:03.100 15:08:06 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:07:03.100 15:08:06 -- common/autotest_common.sh@817 -- # '[' -z 504144 ']' 00:07:03.100 15:08:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:03.100 15:08:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:03.100 15:08:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:03.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:03.100 15:08:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:03.100 15:08:06 -- common/autotest_common.sh@10 -- # set +x 00:07:03.100 [2024-04-24 15:08:06.842074] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:03.100 [2024-04-24 15:08:06.842135] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid504144 ] 00:07:03.100 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.100 [2024-04-24 15:08:06.948759] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:03.100 [2024-04-24 15:08:06.948786] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.367 [2024-04-24 15:08:07.106545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.934 15:08:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:03.934 15:08:07 -- common/autotest_common.sh@850 -- # return 0 00:07:03.934 15:08:07 -- event/cpu_locks.sh@87 -- # locks_exist 504024 00:07:03.934 15:08:07 -- event/cpu_locks.sh@22 -- # lslocks -p 504024 00:07:03.934 15:08:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:05.310 lslocks: write error 00:07:05.310 15:08:08 -- event/cpu_locks.sh@89 -- # killprocess 504024 00:07:05.310 15:08:08 -- common/autotest_common.sh@936 -- # '[' -z 504024 ']' 00:07:05.310 15:08:08 -- common/autotest_common.sh@940 -- # kill -0 504024 00:07:05.310 15:08:08 -- common/autotest_common.sh@941 -- # uname 00:07:05.310 15:08:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:05.310 15:08:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 504024 00:07:05.310 15:08:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:05.310 15:08:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:05.310 15:08:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 504024' 00:07:05.310 killing process with pid 504024 00:07:05.310 15:08:08 -- common/autotest_common.sh@955 -- # kill 504024 00:07:05.310 15:08:08 -- common/autotest_common.sh@960 -- # wait 504024 00:07:05.878 15:08:09 -- event/cpu_locks.sh@90 -- # killprocess 504144 00:07:05.878 15:08:09 -- common/autotest_common.sh@936 -- # '[' -z 504144 ']' 00:07:05.878 15:08:09 -- common/autotest_common.sh@940 -- # kill -0 504144 00:07:05.878 15:08:09 -- common/autotest_common.sh@941 -- # uname 00:07:05.878 15:08:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:05.878 15:08:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 504144 00:07:05.878 15:08:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:05.878 15:08:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:05.878 15:08:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 504144' 00:07:05.878 killing process with pid 504144 00:07:05.878 15:08:09 -- common/autotest_common.sh@955 -- # kill 504144 00:07:05.878 15:08:09 -- common/autotest_common.sh@960 -- # wait 504144 00:07:06.446 00:07:06.446 real 0m4.119s 00:07:06.446 user 0m4.339s 00:07:06.446 sys 0m1.389s 00:07:06.446 15:08:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:06.446 15:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:06.446 ************************************ 00:07:06.446 END TEST non_locking_app_on_locked_coremask 00:07:06.446 ************************************ 00:07:06.446 15:08:10 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:07:06.446 15:08:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:06.446 15:08:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.446 15:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:06.446 ************************************ 00:07:06.446 START TEST locking_app_on_unlocked_coremask 00:07:06.446 ************************************ 00:07:06.446 15:08:10 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:07:06.446 15:08:10 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=504603 00:07:06.446 15:08:10 -- event/cpu_locks.sh@99 -- # waitforlisten 504603 /var/tmp/spdk.sock 00:07:06.446 15:08:10 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:06.446 15:08:10 -- common/autotest_common.sh@817 -- # '[' -z 504603 ']' 00:07:06.446 15:08:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:06.446 15:08:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:06.446 15:08:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:06.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:06.446 15:08:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:06.446 15:08:10 -- common/autotest_common.sh@10 -- # set +x 00:07:06.446 [2024-04-24 15:08:10.333670] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:06.446 [2024-04-24 15:08:10.333718] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid504603 ] 00:07:06.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.705 [2024-04-24 15:08:10.414673] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:06.705 [2024-04-24 15:08:10.414704] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.705 [2024-04-24 15:08:10.499301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.274 15:08:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:07.274 15:08:11 -- common/autotest_common.sh@850 -- # return 0 00:07:07.274 15:08:11 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=504775 00:07:07.274 15:08:11 -- event/cpu_locks.sh@103 -- # waitforlisten 504775 /var/tmp/spdk2.sock 00:07:07.274 15:08:11 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:07.274 15:08:11 -- common/autotest_common.sh@817 -- # '[' -z 504775 ']' 00:07:07.274 15:08:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:07.274 15:08:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:07.274 15:08:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:07.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:07.274 15:08:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:07.274 15:08:11 -- common/autotest_common.sh@10 -- # set +x 00:07:07.274 [2024-04-24 15:08:11.181980] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:07.274 [2024-04-24 15:08:11.182038] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid504775 ] 00:07:07.533 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.533 [2024-04-24 15:08:11.288722] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.792 [2024-04-24 15:08:11.446821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.358 15:08:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:08.358 15:08:11 -- common/autotest_common.sh@850 -- # return 0 00:07:08.358 15:08:11 -- event/cpu_locks.sh@105 -- # locks_exist 504775 00:07:08.358 15:08:11 -- event/cpu_locks.sh@22 -- # lslocks -p 504775 00:07:08.358 15:08:11 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:09.297 lslocks: write error 00:07:09.297 15:08:13 -- event/cpu_locks.sh@107 -- # killprocess 504603 00:07:09.297 15:08:13 -- common/autotest_common.sh@936 -- # '[' -z 504603 ']' 00:07:09.297 15:08:13 -- common/autotest_common.sh@940 -- # kill -0 504603 00:07:09.297 15:08:13 -- common/autotest_common.sh@941 -- # uname 00:07:09.297 15:08:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:09.297 15:08:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 504603 00:07:09.556 15:08:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:09.556 15:08:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:09.556 15:08:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 504603' 00:07:09.556 killing process with pid 504603 00:07:09.556 15:08:13 -- common/autotest_common.sh@955 -- # kill 504603 00:07:09.556 15:08:13 -- common/autotest_common.sh@960 -- # wait 504603 00:07:10.216 15:08:13 -- event/cpu_locks.sh@108 -- # killprocess 504775 00:07:10.216 15:08:13 -- common/autotest_common.sh@936 -- # '[' -z 504775 ']' 00:07:10.216 15:08:13 -- common/autotest_common.sh@940 -- # kill -0 504775 00:07:10.216 15:08:13 -- common/autotest_common.sh@941 -- # uname 00:07:10.216 15:08:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:10.216 15:08:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 504775 00:07:10.216 15:08:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:10.216 15:08:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:10.216 15:08:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 504775' 00:07:10.216 killing process with pid 504775 00:07:10.216 15:08:14 -- common/autotest_common.sh@955 -- # kill 504775 00:07:10.216 15:08:14 -- common/autotest_common.sh@960 -- # wait 504775 00:07:10.557 00:07:10.557 real 0m4.113s 00:07:10.557 user 0m4.317s 00:07:10.557 sys 0m1.337s 00:07:10.557 15:08:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:10.557 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:10.557 ************************************ 00:07:10.557 END TEST locking_app_on_unlocked_coremask 00:07:10.557 ************************************ 00:07:10.557 15:08:14 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:10.557 15:08:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:10.557 15:08:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.558 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:10.842 ************************************ 00:07:10.842 START TEST locking_app_on_locked_coremask 00:07:10.842 ************************************ 00:07:10.842 15:08:14 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:07:10.842 15:08:14 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=505179 00:07:10.842 15:08:14 -- event/cpu_locks.sh@116 -- # waitforlisten 505179 /var/tmp/spdk.sock 00:07:10.842 15:08:14 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:10.842 15:08:14 -- common/autotest_common.sh@817 -- # '[' -z 505179 ']' 00:07:10.842 15:08:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:10.842 15:08:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:10.842 15:08:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:10.842 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:10.842 15:08:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:10.842 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:07:10.842 [2024-04-24 15:08:14.629016] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:10.842 [2024-04-24 15:08:14.629063] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid505179 ] 00:07:10.842 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.842 [2024-04-24 15:08:14.711410] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.101 [2024-04-24 15:08:14.794746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.670 15:08:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:11.670 15:08:15 -- common/autotest_common.sh@850 -- # return 0 00:07:11.670 15:08:15 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:11.670 15:08:15 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=505355 00:07:11.670 15:08:15 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 505355 /var/tmp/spdk2.sock 00:07:11.670 15:08:15 -- common/autotest_common.sh@638 -- # local es=0 00:07:11.670 15:08:15 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 505355 /var/tmp/spdk2.sock 00:07:11.670 15:08:15 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:11.670 15:08:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:11.670 15:08:15 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:11.670 15:08:15 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:11.670 15:08:15 -- common/autotest_common.sh@641 -- # waitforlisten 505355 /var/tmp/spdk2.sock 00:07:11.670 15:08:15 -- common/autotest_common.sh@817 -- # '[' -z 505355 ']' 00:07:11.670 15:08:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:11.670 15:08:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:11.670 15:08:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:11.670 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:11.670 15:08:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:11.670 15:08:15 -- common/autotest_common.sh@10 -- # set +x 00:07:11.670 [2024-04-24 15:08:15.472986] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:11.670 [2024-04-24 15:08:15.473042] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid505355 ] 00:07:11.670 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.670 [2024-04-24 15:08:15.579323] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 505179 has claimed it. 00:07:11.670 [2024-04-24 15:08:15.579364] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:12.238 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (505355) - No such process 00:07:12.238 ERROR: process (pid: 505355) is no longer running 00:07:12.238 15:08:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:12.238 15:08:16 -- common/autotest_common.sh@850 -- # return 1 00:07:12.238 15:08:16 -- common/autotest_common.sh@641 -- # es=1 00:07:12.238 15:08:16 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:12.238 15:08:16 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:12.238 15:08:16 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:12.238 15:08:16 -- event/cpu_locks.sh@122 -- # locks_exist 505179 00:07:12.238 15:08:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:12.238 15:08:16 -- event/cpu_locks.sh@22 -- # lslocks -p 505179 00:07:12.806 lslocks: write error 00:07:12.806 15:08:16 -- event/cpu_locks.sh@124 -- # killprocess 505179 00:07:12.806 15:08:16 -- common/autotest_common.sh@936 -- # '[' -z 505179 ']' 00:07:12.806 15:08:16 -- common/autotest_common.sh@940 -- # kill -0 505179 00:07:12.806 15:08:16 -- common/autotest_common.sh@941 -- # uname 00:07:12.806 15:08:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:12.806 15:08:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 505179 00:07:12.806 15:08:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:12.806 15:08:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:12.806 15:08:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 505179' 00:07:12.806 killing process with pid 505179 00:07:12.806 15:08:16 -- common/autotest_common.sh@955 -- # kill 505179 00:07:12.806 15:08:16 -- common/autotest_common.sh@960 -- # wait 505179 00:07:13.375 00:07:13.375 real 0m2.498s 00:07:13.375 user 0m2.679s 00:07:13.375 sys 0m0.770s 00:07:13.375 15:08:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.375 15:08:17 -- common/autotest_common.sh@10 -- # set +x 00:07:13.375 ************************************ 00:07:13.375 END TEST locking_app_on_locked_coremask 00:07:13.375 ************************************ 00:07:13.375 15:08:17 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:13.375 15:08:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:13.375 15:08:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.375 15:08:17 -- common/autotest_common.sh@10 -- # set +x 00:07:13.634 ************************************ 00:07:13.635 START TEST locking_overlapped_coremask 00:07:13.635 ************************************ 00:07:13.635 15:08:17 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:07:13.635 15:08:17 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=505572 00:07:13.635 15:08:17 -- event/cpu_locks.sh@133 -- # waitforlisten 505572 /var/tmp/spdk.sock 00:07:13.635 15:08:17 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:13.635 15:08:17 -- common/autotest_common.sh@817 -- # '[' -z 505572 ']' 00:07:13.635 15:08:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:13.635 15:08:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:13.635 15:08:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:13.635 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:13.635 15:08:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:13.635 15:08:17 -- common/autotest_common.sh@10 -- # set +x 00:07:13.635 [2024-04-24 15:08:17.343197] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:13.635 [2024-04-24 15:08:17.343256] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid505572 ] 00:07:13.635 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.635 [2024-04-24 15:08:17.426324] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:13.635 [2024-04-24 15:08:17.505698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:13.635 [2024-04-24 15:08:17.505761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:13.635 [2024-04-24 15:08:17.505763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.572 15:08:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:14.572 15:08:18 -- common/autotest_common.sh@850 -- # return 0 00:07:14.572 15:08:18 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:14.572 15:08:18 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=505750 00:07:14.572 15:08:18 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 505750 /var/tmp/spdk2.sock 00:07:14.572 15:08:18 -- common/autotest_common.sh@638 -- # local es=0 00:07:14.572 15:08:18 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 505750 /var/tmp/spdk2.sock 00:07:14.572 15:08:18 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:14.572 15:08:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:14.572 15:08:18 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:14.572 15:08:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:14.572 15:08:18 -- common/autotest_common.sh@641 -- # waitforlisten 505750 /var/tmp/spdk2.sock 00:07:14.572 15:08:18 -- common/autotest_common.sh@817 -- # '[' -z 505750 ']' 00:07:14.572 15:08:18 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:14.572 15:08:18 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:14.572 15:08:18 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:14.572 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:14.572 15:08:18 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:14.572 15:08:18 -- common/autotest_common.sh@10 -- # set +x 00:07:14.572 [2024-04-24 15:08:18.190589] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:14.572 [2024-04-24 15:08:18.190639] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid505750 ] 00:07:14.572 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.572 [2024-04-24 15:08:18.301080] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 505572 has claimed it. 00:07:14.572 [2024-04-24 15:08:18.301123] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:15.142 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (505750) - No such process 00:07:15.142 ERROR: process (pid: 505750) is no longer running 00:07:15.142 15:08:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:15.142 15:08:18 -- common/autotest_common.sh@850 -- # return 1 00:07:15.142 15:08:18 -- common/autotest_common.sh@641 -- # es=1 00:07:15.142 15:08:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:15.142 15:08:18 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:15.142 15:08:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:15.142 15:08:18 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:15.142 15:08:18 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:15.142 15:08:18 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:15.142 15:08:18 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:15.142 15:08:18 -- event/cpu_locks.sh@141 -- # killprocess 505572 00:07:15.142 15:08:18 -- common/autotest_common.sh@936 -- # '[' -z 505572 ']' 00:07:15.142 15:08:18 -- common/autotest_common.sh@940 -- # kill -0 505572 00:07:15.142 15:08:18 -- common/autotest_common.sh@941 -- # uname 00:07:15.142 15:08:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:15.142 15:08:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 505572 00:07:15.142 15:08:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:15.142 15:08:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:15.142 15:08:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 505572' 00:07:15.142 killing process with pid 505572 00:07:15.142 15:08:18 -- common/autotest_common.sh@955 -- # kill 505572 00:07:15.142 15:08:18 -- common/autotest_common.sh@960 -- # wait 505572 00:07:15.401 00:07:15.401 real 0m1.917s 00:07:15.401 user 0m5.195s 00:07:15.401 sys 0m0.497s 00:07:15.401 15:08:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:15.401 15:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:15.401 ************************************ 00:07:15.401 END TEST locking_overlapped_coremask 00:07:15.401 ************************************ 00:07:15.401 15:08:19 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:15.401 15:08:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:15.401 15:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.401 15:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:15.661 ************************************ 00:07:15.661 START TEST locking_overlapped_coremask_via_rpc 00:07:15.661 ************************************ 00:07:15.662 15:08:19 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:07:15.662 15:08:19 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:15.662 15:08:19 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=505960 00:07:15.662 15:08:19 -- event/cpu_locks.sh@149 -- # waitforlisten 505960 /var/tmp/spdk.sock 00:07:15.662 15:08:19 -- common/autotest_common.sh@817 -- # '[' -z 505960 ']' 00:07:15.662 15:08:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.662 15:08:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:15.662 15:08:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.662 15:08:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:15.662 15:08:19 -- common/autotest_common.sh@10 -- # set +x 00:07:15.662 [2024-04-24 15:08:19.429638] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:15.662 [2024-04-24 15:08:19.429696] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid505960 ] 00:07:15.662 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.662 [2024-04-24 15:08:19.504918] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:15.662 [2024-04-24 15:08:19.504951] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:15.921 [2024-04-24 15:08:19.591120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:15.921 [2024-04-24 15:08:19.591215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:15.921 [2024-04-24 15:08:19.591217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.522 15:08:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:16.522 15:08:20 -- common/autotest_common.sh@850 -- # return 0 00:07:16.522 15:08:20 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=506088 00:07:16.522 15:08:20 -- event/cpu_locks.sh@153 -- # waitforlisten 506088 /var/tmp/spdk2.sock 00:07:16.522 15:08:20 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:16.522 15:08:20 -- common/autotest_common.sh@817 -- # '[' -z 506088 ']' 00:07:16.522 15:08:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:16.522 15:08:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:16.522 15:08:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:16.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:16.522 15:08:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:16.522 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:07:16.522 [2024-04-24 15:08:20.299829] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:16.522 [2024-04-24 15:08:20.299885] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid506088 ] 00:07:16.522 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.522 [2024-04-24 15:08:20.416065] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:16.522 [2024-04-24 15:08:20.416092] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:16.782 [2024-04-24 15:08:20.575330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.782 [2024-04-24 15:08:20.575435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.782 [2024-04-24 15:08:20.575437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:07:17.352 15:08:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:17.352 15:08:21 -- common/autotest_common.sh@850 -- # return 0 00:07:17.352 15:08:21 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:17.352 15:08:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.352 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.352 15:08:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:17.352 15:08:21 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.352 15:08:21 -- common/autotest_common.sh@638 -- # local es=0 00:07:17.352 15:08:21 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.352 15:08:21 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:07:17.352 15:08:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:17.352 15:08:21 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:07:17.352 15:08:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:17.352 15:08:21 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:17.352 15:08:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:17.352 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.352 [2024-04-24 15:08:21.141560] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 505960 has claimed it. 00:07:17.352 request: 00:07:17.352 { 00:07:17.352 "method": "framework_enable_cpumask_locks", 00:07:17.352 "req_id": 1 00:07:17.352 } 00:07:17.352 Got JSON-RPC error response 00:07:17.352 response: 00:07:17.352 { 00:07:17.352 "code": -32603, 00:07:17.352 "message": "Failed to claim CPU core: 2" 00:07:17.352 } 00:07:17.352 15:08:21 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:07:17.352 15:08:21 -- common/autotest_common.sh@641 -- # es=1 00:07:17.352 15:08:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:17.352 15:08:21 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:17.352 15:08:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:17.352 15:08:21 -- event/cpu_locks.sh@158 -- # waitforlisten 505960 /var/tmp/spdk.sock 00:07:17.352 15:08:21 -- common/autotest_common.sh@817 -- # '[' -z 505960 ']' 00:07:17.352 15:08:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.352 15:08:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:17.352 15:08:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.352 15:08:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:17.352 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.612 15:08:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:17.612 15:08:21 -- common/autotest_common.sh@850 -- # return 0 00:07:17.612 15:08:21 -- event/cpu_locks.sh@159 -- # waitforlisten 506088 /var/tmp/spdk2.sock 00:07:17.612 15:08:21 -- common/autotest_common.sh@817 -- # '[' -z 506088 ']' 00:07:17.612 15:08:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:17.612 15:08:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:17.612 15:08:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:17.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:17.612 15:08:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:17.612 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.873 15:08:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:17.873 15:08:21 -- common/autotest_common.sh@850 -- # return 0 00:07:17.873 15:08:21 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:17.873 15:08:21 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:17.873 15:08:21 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:17.873 15:08:21 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:17.873 00:07:17.873 real 0m2.137s 00:07:17.873 user 0m0.858s 00:07:17.873 sys 0m0.200s 00:07:17.873 15:08:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:17.873 15:08:21 -- common/autotest_common.sh@10 -- # set +x 00:07:17.873 ************************************ 00:07:17.873 END TEST locking_overlapped_coremask_via_rpc 00:07:17.873 ************************************ 00:07:17.873 15:08:21 -- event/cpu_locks.sh@174 -- # cleanup 00:07:17.873 15:08:21 -- event/cpu_locks.sh@15 -- # [[ -z 505960 ]] 00:07:17.873 15:08:21 -- event/cpu_locks.sh@15 -- # killprocess 505960 00:07:17.873 15:08:21 -- common/autotest_common.sh@936 -- # '[' -z 505960 ']' 00:07:17.873 15:08:21 -- common/autotest_common.sh@940 -- # kill -0 505960 00:07:17.873 15:08:21 -- common/autotest_common.sh@941 -- # uname 00:07:17.873 15:08:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:17.873 15:08:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 505960 00:07:17.873 15:08:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:17.873 15:08:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:17.873 15:08:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 505960' 00:07:17.873 killing process with pid 505960 00:07:17.873 15:08:21 -- common/autotest_common.sh@955 -- # kill 505960 00:07:17.873 15:08:21 -- common/autotest_common.sh@960 -- # wait 505960 00:07:18.133 15:08:21 -- event/cpu_locks.sh@16 -- # [[ -z 506088 ]] 00:07:18.133 15:08:21 -- event/cpu_locks.sh@16 -- # killprocess 506088 00:07:18.133 15:08:21 -- common/autotest_common.sh@936 -- # '[' -z 506088 ']' 00:07:18.133 15:08:21 -- common/autotest_common.sh@940 -- # kill -0 506088 00:07:18.133 15:08:21 -- common/autotest_common.sh@941 -- # uname 00:07:18.133 15:08:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:18.133 15:08:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 506088 00:07:18.133 15:08:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:18.133 15:08:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:18.133 15:08:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 506088' 00:07:18.133 killing process with pid 506088 00:07:18.133 15:08:22 -- common/autotest_common.sh@955 -- # kill 506088 00:07:18.133 15:08:22 -- common/autotest_common.sh@960 -- # wait 506088 00:07:18.702 15:08:22 -- event/cpu_locks.sh@18 -- # rm -f 00:07:18.702 15:08:22 -- event/cpu_locks.sh@1 -- # cleanup 00:07:18.702 15:08:22 -- event/cpu_locks.sh@15 -- # [[ -z 505960 ]] 00:07:18.702 15:08:22 -- event/cpu_locks.sh@15 -- # killprocess 505960 00:07:18.702 15:08:22 -- common/autotest_common.sh@936 -- # '[' -z 505960 ']' 00:07:18.702 15:08:22 -- common/autotest_common.sh@940 -- # kill -0 505960 00:07:18.702 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (505960) - No such process 00:07:18.702 15:08:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 505960 is not found' 00:07:18.702 Process with pid 505960 is not found 00:07:18.702 15:08:22 -- event/cpu_locks.sh@16 -- # [[ -z 506088 ]] 00:07:18.702 15:08:22 -- event/cpu_locks.sh@16 -- # killprocess 506088 00:07:18.702 15:08:22 -- common/autotest_common.sh@936 -- # '[' -z 506088 ']' 00:07:18.702 15:08:22 -- common/autotest_common.sh@940 -- # kill -0 506088 00:07:18.702 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (506088) - No such process 00:07:18.702 15:08:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 506088 is not found' 00:07:18.702 Process with pid 506088 is not found 00:07:18.702 15:08:22 -- event/cpu_locks.sh@18 -- # rm -f 00:07:18.702 00:07:18.702 real 0m20.386s 00:07:18.702 user 0m31.906s 00:07:18.702 sys 0m6.864s 00:07:18.702 15:08:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:18.702 15:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:18.702 ************************************ 00:07:18.702 END TEST cpu_locks 00:07:18.702 ************************************ 00:07:18.702 00:07:18.702 real 0m46.826s 00:07:18.702 user 1m22.968s 00:07:18.702 sys 0m11.494s 00:07:18.702 15:08:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:18.702 15:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:18.702 ************************************ 00:07:18.702 END TEST event 00:07:18.702 ************************************ 00:07:18.702 15:08:22 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/thread.sh 00:07:18.702 15:08:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:18.702 15:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.702 15:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:18.962 ************************************ 00:07:18.962 START TEST thread 00:07:18.962 ************************************ 00:07:18.962 15:08:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/thread.sh 00:07:18.962 * Looking for test storage... 00:07:18.962 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread 00:07:18.962 15:08:22 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:18.962 15:08:22 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:18.962 15:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.962 15:08:22 -- common/autotest_common.sh@10 -- # set +x 00:07:19.223 ************************************ 00:07:19.223 START TEST thread_poller_perf 00:07:19.223 ************************************ 00:07:19.223 15:08:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:19.223 [2024-04-24 15:08:22.987422] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:19.223 [2024-04-24 15:08:22.987532] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid506580 ] 00:07:19.223 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.223 [2024-04-24 15:08:23.070595] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.483 [2024-04-24 15:08:23.148628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.483 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:20.424 ====================================== 00:07:20.424 busy:2307905116 (cyc) 00:07:20.424 total_run_count: 416000 00:07:20.424 tsc_hz: 2300000000 (cyc) 00:07:20.424 ====================================== 00:07:20.424 poller_cost: 5547 (cyc), 2411 (nsec) 00:07:20.424 00:07:20.424 real 0m1.290s 00:07:20.424 user 0m1.190s 00:07:20.424 sys 0m0.096s 00:07:20.424 15:08:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:20.424 15:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:20.424 ************************************ 00:07:20.424 END TEST thread_poller_perf 00:07:20.424 ************************************ 00:07:20.424 15:08:24 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:20.424 15:08:24 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:20.424 15:08:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.424 15:08:24 -- common/autotest_common.sh@10 -- # set +x 00:07:20.684 ************************************ 00:07:20.684 START TEST thread_poller_perf 00:07:20.684 ************************************ 00:07:20.684 15:08:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:20.684 [2024-04-24 15:08:24.495641] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:20.684 [2024-04-24 15:08:24.495726] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid506803 ] 00:07:20.684 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.684 [2024-04-24 15:08:24.578696] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.943 [2024-04-24 15:08:24.664965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.943 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:21.883 ====================================== 00:07:21.883 busy:2301938154 (cyc) 00:07:21.883 total_run_count: 5410000 00:07:21.883 tsc_hz: 2300000000 (cyc) 00:07:21.883 ====================================== 00:07:21.883 poller_cost: 425 (cyc), 184 (nsec) 00:07:21.883 00:07:21.883 real 0m1.294s 00:07:21.883 user 0m1.186s 00:07:21.883 sys 0m0.103s 00:07:21.883 15:08:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:21.883 15:08:25 -- common/autotest_common.sh@10 -- # set +x 00:07:21.883 ************************************ 00:07:21.883 END TEST thread_poller_perf 00:07:21.883 ************************************ 00:07:22.143 15:08:25 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:22.143 00:07:22.143 real 0m3.125s 00:07:22.143 user 0m2.567s 00:07:22.143 sys 0m0.525s 00:07:22.143 15:08:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:22.143 15:08:25 -- common/autotest_common.sh@10 -- # set +x 00:07:22.143 ************************************ 00:07:22.143 END TEST thread 00:07:22.143 ************************************ 00:07:22.143 15:08:25 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel.sh 00:07:22.143 15:08:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:22.143 15:08:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.143 15:08:25 -- common/autotest_common.sh@10 -- # set +x 00:07:22.143 ************************************ 00:07:22.143 START TEST accel 00:07:22.143 ************************************ 00:07:22.143 15:08:26 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel.sh 00:07:22.403 * Looking for test storage... 00:07:22.403 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel 00:07:22.403 15:08:26 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:07:22.403 15:08:26 -- accel/accel.sh@82 -- # get_expected_opcs 00:07:22.403 15:08:26 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:22.403 15:08:26 -- accel/accel.sh@62 -- # spdk_tgt_pid=507052 00:07:22.403 15:08:26 -- accel/accel.sh@63 -- # waitforlisten 507052 00:07:22.403 15:08:26 -- common/autotest_common.sh@817 -- # '[' -z 507052 ']' 00:07:22.403 15:08:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:22.403 15:08:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:22.403 15:08:26 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:22.403 15:08:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:22.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:22.403 15:08:26 -- accel/accel.sh@61 -- # build_accel_config 00:07:22.403 15:08:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:22.403 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:22.403 15:08:26 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:22.403 15:08:26 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:22.403 15:08:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.403 15:08:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.403 15:08:26 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:22.403 15:08:26 -- accel/accel.sh@40 -- # local IFS=, 00:07:22.403 15:08:26 -- accel/accel.sh@41 -- # jq -r . 00:07:22.403 [2024-04-24 15:08:26.151997] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:22.403 [2024-04-24 15:08:26.152070] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid507052 ] 00:07:22.403 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.403 [2024-04-24 15:08:26.232327] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.663 [2024-04-24 15:08:26.317424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.234 15:08:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:23.234 15:08:26 -- common/autotest_common.sh@850 -- # return 0 00:07:23.234 15:08:26 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:07:23.234 15:08:26 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:07:23.234 15:08:26 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:07:23.234 15:08:26 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:07:23.234 15:08:26 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:23.234 15:08:26 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:07:23.234 15:08:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:23.234 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:07:23.234 15:08:26 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:23.234 15:08:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:23.234 15:08:26 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:26 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:26 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:26 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:26 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:26 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:26 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:26 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:26 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:26 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:26 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.234 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.234 15:08:27 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:23.234 15:08:27 -- accel/accel.sh@72 -- # IFS== 00:07:23.235 15:08:27 -- accel/accel.sh@72 -- # read -r opc module 00:07:23.235 15:08:27 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:23.235 15:08:27 -- accel/accel.sh@75 -- # killprocess 507052 00:07:23.235 15:08:27 -- common/autotest_common.sh@936 -- # '[' -z 507052 ']' 00:07:23.235 15:08:27 -- common/autotest_common.sh@940 -- # kill -0 507052 00:07:23.235 15:08:27 -- common/autotest_common.sh@941 -- # uname 00:07:23.235 15:08:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:23.235 15:08:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 507052 00:07:23.235 15:08:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:23.235 15:08:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:23.235 15:08:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 507052' 00:07:23.235 killing process with pid 507052 00:07:23.235 15:08:27 -- common/autotest_common.sh@955 -- # kill 507052 00:07:23.235 15:08:27 -- common/autotest_common.sh@960 -- # wait 507052 00:07:23.805 15:08:27 -- accel/accel.sh@76 -- # trap - ERR 00:07:23.805 15:08:27 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:07:23.805 15:08:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:23.805 15:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.805 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:23.805 15:08:27 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:07:23.805 15:08:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.805 15:08:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:23.805 15:08:27 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:23.805 15:08:27 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:23.805 15:08:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.805 15:08:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.805 15:08:27 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:23.805 15:08:27 -- accel/accel.sh@40 -- # local IFS=, 00:07:23.805 15:08:27 -- accel/accel.sh@41 -- # jq -r . 00:07:23.805 15:08:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:23.805 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:23.805 15:08:27 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:23.805 15:08:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:23.805 15:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.805 15:08:27 -- common/autotest_common.sh@10 -- # set +x 00:07:24.065 ************************************ 00:07:24.065 START TEST accel_missing_filename 00:07:24.065 ************************************ 00:07:24.065 15:08:27 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:07:24.065 15:08:27 -- common/autotest_common.sh@638 -- # local es=0 00:07:24.065 15:08:27 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:24.065 15:08:27 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:24.065 15:08:27 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:24.065 15:08:27 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:24.065 15:08:27 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:24.065 15:08:27 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:07:24.065 15:08:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.065 15:08:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:24.065 15:08:27 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:24.065 15:08:27 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:24.065 15:08:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.065 15:08:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.065 15:08:27 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:24.065 15:08:27 -- accel/accel.sh@40 -- # local IFS=, 00:07:24.065 15:08:27 -- accel/accel.sh@41 -- # jq -r . 00:07:24.065 [2024-04-24 15:08:27.808213] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:24.065 [2024-04-24 15:08:27.808269] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid507282 ] 00:07:24.065 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.065 [2024-04-24 15:08:27.890773] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.065 [2024-04-24 15:08:27.969110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.325 [2024-04-24 15:08:28.016712] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:24.325 [2024-04-24 15:08:28.086359] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:24.325 A filename is required. 00:07:24.325 15:08:28 -- common/autotest_common.sh@641 -- # es=234 00:07:24.325 15:08:28 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:24.325 15:08:28 -- common/autotest_common.sh@650 -- # es=106 00:07:24.325 15:08:28 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:24.325 15:08:28 -- common/autotest_common.sh@658 -- # es=1 00:07:24.325 15:08:28 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:24.325 00:07:24.325 real 0m0.410s 00:07:24.325 user 0m0.284s 00:07:24.325 sys 0m0.150s 00:07:24.325 15:08:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:24.325 15:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:24.325 ************************************ 00:07:24.325 END TEST accel_missing_filename 00:07:24.325 ************************************ 00:07:24.325 15:08:28 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:24.325 15:08:28 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:24.325 15:08:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.325 15:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:24.586 ************************************ 00:07:24.586 START TEST accel_compress_verify 00:07:24.586 ************************************ 00:07:24.586 15:08:28 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:24.586 15:08:28 -- common/autotest_common.sh@638 -- # local es=0 00:07:24.586 15:08:28 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:24.586 15:08:28 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:24.586 15:08:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:24.586 15:08:28 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:24.586 15:08:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:24.586 15:08:28 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:24.586 15:08:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:24.586 15:08:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.586 15:08:28 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:24.586 15:08:28 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:24.586 15:08:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.586 15:08:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.586 15:08:28 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:24.586 15:08:28 -- accel/accel.sh@40 -- # local IFS=, 00:07:24.586 15:08:28 -- accel/accel.sh@41 -- # jq -r . 00:07:24.586 [2024-04-24 15:08:28.434481] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:24.586 [2024-04-24 15:08:28.434550] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid507476 ] 00:07:24.586 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.846 [2024-04-24 15:08:28.518150] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.846 [2024-04-24 15:08:28.602461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.846 [2024-04-24 15:08:28.649958] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:24.846 [2024-04-24 15:08:28.719771] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:25.106 00:07:25.106 Compression does not support the verify option, aborting. 00:07:25.106 15:08:28 -- common/autotest_common.sh@641 -- # es=161 00:07:25.106 15:08:28 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:25.106 15:08:28 -- common/autotest_common.sh@650 -- # es=33 00:07:25.106 15:08:28 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:25.106 15:08:28 -- common/autotest_common.sh@658 -- # es=1 00:07:25.106 15:08:28 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:25.106 00:07:25.106 real 0m0.413s 00:07:25.106 user 0m0.289s 00:07:25.106 sys 0m0.160s 00:07:25.106 15:08:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.106 15:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:25.106 ************************************ 00:07:25.106 END TEST accel_compress_verify 00:07:25.106 ************************************ 00:07:25.106 15:08:28 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:25.106 15:08:28 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:25.106 15:08:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.106 15:08:28 -- common/autotest_common.sh@10 -- # set +x 00:07:25.106 ************************************ 00:07:25.106 START TEST accel_wrong_workload 00:07:25.106 ************************************ 00:07:25.106 15:08:28 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:07:25.106 15:08:28 -- common/autotest_common.sh@638 -- # local es=0 00:07:25.106 15:08:28 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:25.106 15:08:28 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:25.106 15:08:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:25.106 15:08:28 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:25.106 15:08:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:25.106 15:08:28 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:07:25.106 15:08:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:25.106 15:08:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.106 15:08:28 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:25.106 15:08:28 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:25.106 15:08:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.106 15:08:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.106 15:08:29 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:25.106 15:08:29 -- accel/accel.sh@40 -- # local IFS=, 00:07:25.106 15:08:29 -- accel/accel.sh@41 -- # jq -r . 00:07:25.106 Unsupported workload type: foobar 00:07:25.106 [2024-04-24 15:08:29.013791] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:25.106 accel_perf options: 00:07:25.106 [-h help message] 00:07:25.106 [-q queue depth per core] 00:07:25.106 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:25.106 [-T number of threads per core 00:07:25.106 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:25.106 [-t time in seconds] 00:07:25.106 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:25.106 [ dif_verify, , dif_generate, dif_generate_copy 00:07:25.106 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:25.106 [-l for compress/decompress workloads, name of uncompressed input file 00:07:25.106 [-S for crc32c workload, use this seed value (default 0) 00:07:25.106 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:25.106 [-f for fill workload, use this BYTE value (default 255) 00:07:25.106 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:25.106 [-y verify result if this switch is on] 00:07:25.106 [-a tasks to allocate per core (default: same value as -q)] 00:07:25.106 Can be used to spread operations across a wider range of memory. 00:07:25.106 15:08:29 -- common/autotest_common.sh@641 -- # es=1 00:07:25.367 15:08:29 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:25.367 15:08:29 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:25.367 15:08:29 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:25.367 00:07:25.367 real 0m0.025s 00:07:25.367 user 0m0.016s 00:07:25.367 sys 0m0.010s 00:07:25.367 15:08:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.367 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:25.367 ************************************ 00:07:25.367 END TEST accel_wrong_workload 00:07:25.367 ************************************ 00:07:25.367 Error: writing output failed: Broken pipe 00:07:25.367 15:08:29 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:25.367 15:08:29 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:25.367 15:08:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.367 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:25.367 ************************************ 00:07:25.367 START TEST accel_negative_buffers 00:07:25.367 ************************************ 00:07:25.367 15:08:29 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:25.367 15:08:29 -- common/autotest_common.sh@638 -- # local es=0 00:07:25.367 15:08:29 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:25.367 15:08:29 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:25.367 15:08:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:25.367 15:08:29 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:25.367 15:08:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:25.367 15:08:29 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:07:25.367 15:08:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:25.367 15:08:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.367 15:08:29 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:25.367 15:08:29 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:25.367 15:08:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.367 15:08:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.367 15:08:29 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:25.367 15:08:29 -- accel/accel.sh@40 -- # local IFS=, 00:07:25.367 15:08:29 -- accel/accel.sh@41 -- # jq -r . 00:07:25.367 -x option must be non-negative. 00:07:25.367 [2024-04-24 15:08:29.260583] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:25.367 accel_perf options: 00:07:25.367 [-h help message] 00:07:25.367 [-q queue depth per core] 00:07:25.367 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:25.367 [-T number of threads per core 00:07:25.367 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:25.367 [-t time in seconds] 00:07:25.367 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:25.367 [ dif_verify, , dif_generate, dif_generate_copy 00:07:25.367 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:25.367 [-l for compress/decompress workloads, name of uncompressed input file 00:07:25.367 [-S for crc32c workload, use this seed value (default 0) 00:07:25.367 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:25.367 [-f for fill workload, use this BYTE value (default 255) 00:07:25.367 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:25.367 [-y verify result if this switch is on] 00:07:25.367 [-a tasks to allocate per core (default: same value as -q)] 00:07:25.367 Can be used to spread operations across a wider range of memory. 00:07:25.367 15:08:29 -- common/autotest_common.sh@641 -- # es=1 00:07:25.367 15:08:29 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:25.367 15:08:29 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:25.367 15:08:29 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:25.367 00:07:25.367 real 0m0.036s 00:07:25.367 user 0m0.045s 00:07:25.367 sys 0m0.017s 00:07:25.367 15:08:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.367 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:25.367 ************************************ 00:07:25.367 END TEST accel_negative_buffers 00:07:25.367 ************************************ 00:07:25.628 15:08:29 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:25.628 15:08:29 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:25.628 15:08:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.628 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:07:25.628 ************************************ 00:07:25.628 START TEST accel_crc32c 00:07:25.628 ************************************ 00:07:25.628 15:08:29 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:25.628 15:08:29 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.628 15:08:29 -- accel/accel.sh@17 -- # local accel_module 00:07:25.628 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.628 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.628 15:08:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:25.628 15:08:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:25.628 15:08:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.628 15:08:29 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:25.628 15:08:29 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:25.628 15:08:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.628 15:08:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.628 15:08:29 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:25.628 15:08:29 -- accel/accel.sh@40 -- # local IFS=, 00:07:25.628 15:08:29 -- accel/accel.sh@41 -- # jq -r . 00:07:25.628 [2024-04-24 15:08:29.512440] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:25.628 [2024-04-24 15:08:29.512511] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid507617 ] 00:07:25.888 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.888 [2024-04-24 15:08:29.596897] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.888 [2024-04-24 15:08:29.679714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=0x1 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=crc32c 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=32 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=software 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@22 -- # accel_module=software 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=32 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=32 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val=1 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.888 15:08:29 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:25.888 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.888 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.889 15:08:29 -- accel/accel.sh@20 -- # val=Yes 00:07:25.889 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.889 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.889 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:25.889 15:08:29 -- accel/accel.sh@20 -- # val= 00:07:25.889 15:08:29 -- accel/accel.sh@21 -- # case "$var" in 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # IFS=: 00:07:25.889 15:08:29 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@20 -- # val= 00:07:27.271 15:08:30 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:30 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:30 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:27.271 15:08:30 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:27.271 15:08:30 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.271 00:07:27.271 real 0m1.425s 00:07:27.271 user 0m1.284s 00:07:27.271 sys 0m0.154s 00:07:27.271 15:08:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:27.271 15:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.271 ************************************ 00:07:27.271 END TEST accel_crc32c 00:07:27.271 ************************************ 00:07:27.271 15:08:30 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:27.271 15:08:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:27.271 15:08:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.271 15:08:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.271 ************************************ 00:07:27.271 START TEST accel_crc32c_C2 00:07:27.271 ************************************ 00:07:27.271 15:08:31 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:27.271 15:08:31 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.271 15:08:31 -- accel/accel.sh@17 -- # local accel_module 00:07:27.271 15:08:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:27.271 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.271 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.271 15:08:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:27.271 15:08:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.271 15:08:31 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:27.271 15:08:31 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:27.271 15:08:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.271 15:08:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.271 15:08:31 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:27.271 15:08:31 -- accel/accel.sh@40 -- # local IFS=, 00:07:27.271 15:08:31 -- accel/accel.sh@41 -- # jq -r . 00:07:27.271 [2024-04-24 15:08:31.093736] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:27.271 [2024-04-24 15:08:31.093795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid507925 ] 00:07:27.271 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.271 [2024-04-24 15:08:31.172220] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.532 [2024-04-24 15:08:31.251433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=0x1 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=crc32c 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=0 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=software 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@22 -- # accel_module=software 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=32 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=32 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=1 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val=Yes 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:27.532 15:08:31 -- accel/accel.sh@20 -- # val= 00:07:27.532 15:08:31 -- accel/accel.sh@21 -- # case "$var" in 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # IFS=: 00:07:27.532 15:08:31 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:28.914 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:28.914 15:08:32 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:28.914 15:08:32 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.914 00:07:28.914 real 0m1.395s 00:07:28.914 user 0m1.268s 00:07:28.914 sys 0m0.140s 00:07:28.914 15:08:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:28.914 15:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.914 ************************************ 00:07:28.914 END TEST accel_crc32c_C2 00:07:28.914 ************************************ 00:07:28.914 15:08:32 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:28.914 15:08:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:28.914 15:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.914 15:08:32 -- common/autotest_common.sh@10 -- # set +x 00:07:28.914 ************************************ 00:07:28.914 START TEST accel_copy 00:07:28.914 ************************************ 00:07:28.914 15:08:32 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:07:28.914 15:08:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.914 15:08:32 -- accel/accel.sh@17 -- # local accel_module 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:28.914 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:28.914 15:08:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:28.914 15:08:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.914 15:08:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:28.914 15:08:32 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:28.914 15:08:32 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:28.914 15:08:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.914 15:08:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.914 15:08:32 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:28.914 15:08:32 -- accel/accel.sh@40 -- # local IFS=, 00:07:28.914 15:08:32 -- accel/accel.sh@41 -- # jq -r . 00:07:28.914 [2024-04-24 15:08:32.688334] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:28.914 [2024-04-24 15:08:32.688410] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid508136 ] 00:07:28.914 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.914 [2024-04-24 15:08:32.768850] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.175 [2024-04-24 15:08:32.849884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=0x1 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=copy 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@23 -- # accel_opc=copy 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=software 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@22 -- # accel_module=software 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=32 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=32 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=1 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val=Yes 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:29.175 15:08:32 -- accel/accel.sh@20 -- # val= 00:07:29.175 15:08:32 -- accel/accel.sh@21 -- # case "$var" in 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # IFS=: 00:07:29.175 15:08:32 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.558 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:30.558 15:08:34 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:07:30.558 15:08:34 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.558 00:07:30.558 real 0m1.412s 00:07:30.558 user 0m1.281s 00:07:30.558 sys 0m0.143s 00:07:30.558 15:08:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:30.558 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:30.558 ************************************ 00:07:30.558 END TEST accel_copy 00:07:30.558 ************************************ 00:07:30.558 15:08:34 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:30.558 15:08:34 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:30.558 15:08:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.558 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:07:30.558 ************************************ 00:07:30.558 START TEST accel_fill 00:07:30.558 ************************************ 00:07:30.558 15:08:34 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:30.558 15:08:34 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.558 15:08:34 -- accel/accel.sh@17 -- # local accel_module 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.558 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.558 15:08:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:30.558 15:08:34 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.558 15:08:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:30.558 15:08:34 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:30.558 15:08:34 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:30.558 15:08:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.558 15:08:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.558 15:08:34 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:30.558 15:08:34 -- accel/accel.sh@40 -- # local IFS=, 00:07:30.558 15:08:34 -- accel/accel.sh@41 -- # jq -r . 00:07:30.558 [2024-04-24 15:08:34.280911] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:30.558 [2024-04-24 15:08:34.280986] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid508340 ] 00:07:30.558 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.558 [2024-04-24 15:08:34.362690] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.558 [2024-04-24 15:08:34.440762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=0x1 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=fill 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@23 -- # accel_opc=fill 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=0x80 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=software 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@22 -- # accel_module=software 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=64 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=64 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=1 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val=Yes 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:30.819 15:08:34 -- accel/accel.sh@20 -- # val= 00:07:30.819 15:08:34 -- accel/accel.sh@21 -- # case "$var" in 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # IFS=: 00:07:30.819 15:08:34 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@20 -- # val= 00:07:31.760 15:08:35 -- accel/accel.sh@21 -- # case "$var" in 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:31.760 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:31.760 15:08:35 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:31.760 15:08:35 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:07:31.760 15:08:35 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.760 00:07:31.760 real 0m1.413s 00:07:31.760 user 0m1.269s 00:07:31.760 sys 0m0.158s 00:07:31.760 15:08:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:31.760 15:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:31.760 ************************************ 00:07:31.760 END TEST accel_fill 00:07:31.760 ************************************ 00:07:32.020 15:08:35 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:32.020 15:08:35 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:32.020 15:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.020 15:08:35 -- common/autotest_common.sh@10 -- # set +x 00:07:32.020 ************************************ 00:07:32.020 START TEST accel_copy_crc32c 00:07:32.020 ************************************ 00:07:32.020 15:08:35 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:07:32.020 15:08:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:32.020 15:08:35 -- accel/accel.sh@17 -- # local accel_module 00:07:32.020 15:08:35 -- accel/accel.sh@19 -- # IFS=: 00:07:32.020 15:08:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:32.020 15:08:35 -- accel/accel.sh@19 -- # read -r var val 00:07:32.020 15:08:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.020 15:08:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:32.020 15:08:35 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:32.020 15:08:35 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:32.020 15:08:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.020 15:08:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.020 15:08:35 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:32.020 15:08:35 -- accel/accel.sh@40 -- # local IFS=, 00:07:32.020 15:08:35 -- accel/accel.sh@41 -- # jq -r . 00:07:32.020 [2024-04-24 15:08:35.871746] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:32.020 [2024-04-24 15:08:35.871810] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid508543 ] 00:07:32.020 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.280 [2024-04-24 15:08:35.952174] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.280 [2024-04-24 15:08:36.030689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val=0x1 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val=0 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:32.280 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.280 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.280 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val=software 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@22 -- # accel_module=software 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val=32 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val=32 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val=1 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val=Yes 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:32.281 15:08:36 -- accel/accel.sh@20 -- # val= 00:07:32.281 15:08:36 -- accel/accel.sh@21 -- # case "$var" in 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # IFS=: 00:07:32.281 15:08:36 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.663 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:33.663 15:08:37 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:33.663 15:08:37 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.663 00:07:33.663 real 0m1.409s 00:07:33.663 user 0m1.271s 00:07:33.663 sys 0m0.152s 00:07:33.663 15:08:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:33.663 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:33.663 ************************************ 00:07:33.663 END TEST accel_copy_crc32c 00:07:33.663 ************************************ 00:07:33.663 15:08:37 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:33.663 15:08:37 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:33.663 15:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.663 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:07:33.663 ************************************ 00:07:33.663 START TEST accel_copy_crc32c_C2 00:07:33.663 ************************************ 00:07:33.663 15:08:37 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:33.663 15:08:37 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.663 15:08:37 -- accel/accel.sh@17 -- # local accel_module 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.663 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.663 15:08:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:33.663 15:08:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:33.663 15:08:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.663 15:08:37 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:33.663 15:08:37 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:33.663 15:08:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.663 15:08:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.663 15:08:37 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:33.663 15:08:37 -- accel/accel.sh@40 -- # local IFS=, 00:07:33.663 15:08:37 -- accel/accel.sh@41 -- # jq -r . 00:07:33.663 [2024-04-24 15:08:37.444188] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:33.663 [2024-04-24 15:08:37.444251] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid508763 ] 00:07:33.663 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.663 [2024-04-24 15:08:37.524475] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.924 [2024-04-24 15:08:37.600298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=0x1 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=0 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val='8192 bytes' 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=software 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@22 -- # accel_module=software 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=32 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=32 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=1 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val=Yes 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:33.924 15:08:37 -- accel/accel.sh@20 -- # val= 00:07:33.924 15:08:37 -- accel/accel.sh@21 -- # case "$var" in 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # IFS=: 00:07:33.924 15:08:37 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:38 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:35.307 15:08:38 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:35.307 15:08:38 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.307 00:07:35.307 real 0m1.392s 00:07:35.307 user 0m1.266s 00:07:35.307 sys 0m0.140s 00:07:35.307 15:08:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:35.307 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.307 ************************************ 00:07:35.307 END TEST accel_copy_crc32c_C2 00:07:35.307 ************************************ 00:07:35.307 15:08:38 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:35.307 15:08:38 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:35.307 15:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.307 15:08:38 -- common/autotest_common.sh@10 -- # set +x 00:07:35.307 ************************************ 00:07:35.307 START TEST accel_dualcast 00:07:35.307 ************************************ 00:07:35.307 15:08:38 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:07:35.307 15:08:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:35.307 15:08:38 -- accel/accel.sh@17 -- # local accel_module 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:35.307 15:08:38 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:35.307 15:08:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.307 15:08:38 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:35.307 15:08:38 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:35.307 15:08:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.307 15:08:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.307 15:08:38 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:35.307 15:08:38 -- accel/accel.sh@40 -- # local IFS=, 00:07:35.307 15:08:38 -- accel/accel.sh@41 -- # jq -r . 00:07:35.307 [2024-04-24 15:08:39.004550] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:35.307 [2024-04-24 15:08:39.004598] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid509082 ] 00:07:35.307 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.307 [2024-04-24 15:08:39.085516] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.307 [2024-04-24 15:08:39.163542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val=0x1 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val=dualcast 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.307 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.307 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.307 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val=software 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@22 -- # accel_module=software 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val=32 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val=32 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val=1 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val=Yes 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:35.568 15:08:39 -- accel/accel.sh@20 -- # val= 00:07:35.568 15:08:39 -- accel/accel.sh@21 -- # case "$var" in 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # IFS=: 00:07:35.568 15:08:39 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:36.509 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.509 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.509 15:08:40 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:36.509 15:08:40 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:07:36.509 15:08:40 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.509 00:07:36.509 real 0m1.411s 00:07:36.509 user 0m1.272s 00:07:36.509 sys 0m0.151s 00:07:36.509 15:08:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:36.509 15:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:36.509 ************************************ 00:07:36.509 END TEST accel_dualcast 00:07:36.509 ************************************ 00:07:36.769 15:08:40 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:36.769 15:08:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:36.769 15:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.769 15:08:40 -- common/autotest_common.sh@10 -- # set +x 00:07:36.769 ************************************ 00:07:36.769 START TEST accel_compare 00:07:36.769 ************************************ 00:07:36.769 15:08:40 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:07:36.769 15:08:40 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.769 15:08:40 -- accel/accel.sh@17 -- # local accel_module 00:07:36.769 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:36.769 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:36.769 15:08:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:36.769 15:08:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:36.769 15:08:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.769 15:08:40 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:36.769 15:08:40 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:36.769 15:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.769 15:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.769 15:08:40 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:36.769 15:08:40 -- accel/accel.sh@40 -- # local IFS=, 00:07:36.769 15:08:40 -- accel/accel.sh@41 -- # jq -r . 00:07:36.769 [2024-04-24 15:08:40.596914] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:36.770 [2024-04-24 15:08:40.596967] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid509316 ] 00:07:36.770 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.770 [2024-04-24 15:08:40.678134] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.030 [2024-04-24 15:08:40.757476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=0x1 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=compare 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@23 -- # accel_opc=compare 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=software 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@22 -- # accel_module=software 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=32 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=32 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=1 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val=Yes 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:37.030 15:08:40 -- accel/accel.sh@20 -- # val= 00:07:37.030 15:08:40 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # IFS=: 00:07:37.030 15:08:40 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@20 -- # val= 00:07:38.413 15:08:41 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # IFS=: 00:07:38.413 15:08:41 -- accel/accel.sh@19 -- # read -r var val 00:07:38.413 15:08:41 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:38.413 15:08:41 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:07:38.413 15:08:41 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.413 00:07:38.413 real 0m1.412s 00:07:38.413 user 0m1.278s 00:07:38.413 sys 0m0.145s 00:07:38.413 15:08:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:38.413 15:08:41 -- common/autotest_common.sh@10 -- # set +x 00:07:38.413 ************************************ 00:07:38.413 END TEST accel_compare 00:07:38.413 ************************************ 00:07:38.413 15:08:42 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:38.413 15:08:42 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:38.413 15:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.414 15:08:42 -- common/autotest_common.sh@10 -- # set +x 00:07:38.414 ************************************ 00:07:38.414 START TEST accel_xor 00:07:38.414 ************************************ 00:07:38.414 15:08:42 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:07:38.414 15:08:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.414 15:08:42 -- accel/accel.sh@17 -- # local accel_module 00:07:38.414 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.414 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.414 15:08:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:38.414 15:08:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:38.414 15:08:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.414 15:08:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:38.414 15:08:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:38.414 15:08:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.414 15:08:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.414 15:08:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:38.414 15:08:42 -- accel/accel.sh@40 -- # local IFS=, 00:07:38.414 15:08:42 -- accel/accel.sh@41 -- # jq -r . 00:07:38.414 [2024-04-24 15:08:42.178915] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:38.414 [2024-04-24 15:08:42.178970] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid509517 ] 00:07:38.414 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.414 [2024-04-24 15:08:42.260187] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.674 [2024-04-24 15:08:42.339413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=0x1 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=xor 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=2 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=software 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@22 -- # accel_module=software 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=32 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=32 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=1 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val=Yes 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:38.674 15:08:42 -- accel/accel.sh@20 -- # val= 00:07:38.674 15:08:42 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # IFS=: 00:07:38.674 15:08:42 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:40.057 15:08:43 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:40.057 15:08:43 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:40.057 00:07:40.057 real 0m1.411s 00:07:40.057 user 0m1.274s 00:07:40.057 sys 0m0.150s 00:07:40.057 15:08:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:40.057 15:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:40.057 ************************************ 00:07:40.057 END TEST accel_xor 00:07:40.057 ************************************ 00:07:40.057 15:08:43 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:40.057 15:08:43 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:40.057 15:08:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.057 15:08:43 -- common/autotest_common.sh@10 -- # set +x 00:07:40.057 ************************************ 00:07:40.057 START TEST accel_xor 00:07:40.057 ************************************ 00:07:40.057 15:08:43 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:07:40.057 15:08:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:40.057 15:08:43 -- accel/accel.sh@17 -- # local accel_module 00:07:40.057 15:08:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:40.057 15:08:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.057 15:08:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:40.057 15:08:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:40.057 15:08:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.057 15:08:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.057 15:08:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:40.057 15:08:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:40.057 15:08:43 -- accel/accel.sh@41 -- # jq -r . 00:07:40.057 [2024-04-24 15:08:43.758403] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:40.057 [2024-04-24 15:08:43.758459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid509728 ] 00:07:40.057 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.057 [2024-04-24 15:08:43.837245] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:40.057 [2024-04-24 15:08:43.915435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val=0x1 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.057 15:08:43 -- accel/accel.sh@20 -- # val=xor 00:07:40.057 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.057 15:08:43 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.057 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=3 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=software 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@22 -- # accel_module=software 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=32 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=32 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=1 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val=Yes 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:40.318 15:08:43 -- accel/accel.sh@20 -- # val= 00:07:40.318 15:08:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # IFS=: 00:07:40.318 15:08:43 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.258 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.258 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.258 15:08:45 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:41.258 15:08:45 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:41.258 15:08:45 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.258 00:07:41.258 real 0m1.389s 00:07:41.258 user 0m1.252s 00:07:41.258 sys 0m0.149s 00:07:41.258 15:08:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:41.258 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:41.258 ************************************ 00:07:41.258 END TEST accel_xor 00:07:41.258 ************************************ 00:07:41.258 15:08:45 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:41.258 15:08:45 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:41.258 15:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.258 15:08:45 -- common/autotest_common.sh@10 -- # set +x 00:07:41.517 ************************************ 00:07:41.517 START TEST accel_dif_verify 00:07:41.517 ************************************ 00:07:41.517 15:08:45 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:07:41.517 15:08:45 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.517 15:08:45 -- accel/accel.sh@17 -- # local accel_module 00:07:41.517 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.517 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.517 15:08:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:41.517 15:08:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:41.517 15:08:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.517 15:08:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:41.517 15:08:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:41.517 15:08:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.517 15:08:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.517 15:08:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:41.517 15:08:45 -- accel/accel.sh@40 -- # local IFS=, 00:07:41.517 15:08:45 -- accel/accel.sh@41 -- # jq -r . 00:07:41.517 [2024-04-24 15:08:45.334162] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:41.517 [2024-04-24 15:08:45.334218] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid509927 ] 00:07:41.517 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.517 [2024-04-24 15:08:45.416799] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.778 [2024-04-24 15:08:45.497063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=0x1 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=dif_verify 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=software 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@22 -- # accel_module=software 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=32 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=32 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=1 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val=No 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:41.778 15:08:45 -- accel/accel.sh@20 -- # val= 00:07:41.778 15:08:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # IFS=: 00:07:41.778 15:08:45 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@20 -- # val= 00:07:43.161 15:08:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:43.161 15:08:46 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:07:43.161 15:08:46 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:43.161 00:07:43.161 real 0m1.418s 00:07:43.161 user 0m1.270s 00:07:43.161 sys 0m0.160s 00:07:43.161 15:08:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:43.161 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.161 ************************************ 00:07:43.161 END TEST accel_dif_verify 00:07:43.161 ************************************ 00:07:43.161 15:08:46 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:43.161 15:08:46 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:43.161 15:08:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.161 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:07:43.161 ************************************ 00:07:43.161 START TEST accel_dif_generate 00:07:43.161 ************************************ 00:07:43.161 15:08:46 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:07:43.161 15:08:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:43.161 15:08:46 -- accel/accel.sh@17 -- # local accel_module 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # IFS=: 00:07:43.161 15:08:46 -- accel/accel.sh@19 -- # read -r var val 00:07:43.161 15:08:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:43.161 15:08:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.161 15:08:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:43.161 15:08:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:43.161 15:08:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:43.161 15:08:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.161 15:08:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.161 15:08:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:43.161 15:08:46 -- accel/accel.sh@40 -- # local IFS=, 00:07:43.161 15:08:46 -- accel/accel.sh@41 -- # jq -r . 00:07:43.161 [2024-04-24 15:08:46.928502] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:43.161 [2024-04-24 15:08:46.928561] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid510164 ] 00:07:43.161 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.161 [2024-04-24 15:08:47.011673] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.422 [2024-04-24 15:08:47.092636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=0x1 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=dif_generate 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=software 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@22 -- # accel_module=software 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=32 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=32 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=1 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val=No 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:43.422 15:08:47 -- accel/accel.sh@20 -- # val= 00:07:43.422 15:08:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # IFS=: 00:07:43.422 15:08:47 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:44.805 15:08:48 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:07:44.805 15:08:48 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.805 00:07:44.805 real 0m1.419s 00:07:44.805 user 0m1.289s 00:07:44.805 sys 0m0.145s 00:07:44.805 15:08:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:44.805 15:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:44.805 ************************************ 00:07:44.805 END TEST accel_dif_generate 00:07:44.805 ************************************ 00:07:44.805 15:08:48 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:44.805 15:08:48 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:44.805 15:08:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.805 15:08:48 -- common/autotest_common.sh@10 -- # set +x 00:07:44.805 ************************************ 00:07:44.805 START TEST accel_dif_generate_copy 00:07:44.805 ************************************ 00:07:44.805 15:08:48 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:07:44.805 15:08:48 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.805 15:08:48 -- accel/accel.sh@17 -- # local accel_module 00:07:44.805 15:08:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:44.805 15:08:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.805 15:08:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:44.805 15:08:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:44.805 15:08:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.805 15:08:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.805 15:08:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:44.805 15:08:48 -- accel/accel.sh@40 -- # local IFS=, 00:07:44.805 15:08:48 -- accel/accel.sh@41 -- # jq -r . 00:07:44.805 [2024-04-24 15:08:48.501842] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:44.805 [2024-04-24 15:08:48.501887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid510480 ] 00:07:44.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.805 [2024-04-24 15:08:48.581770] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.805 [2024-04-24 15:08:48.657376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=0x1 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=software 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@22 -- # accel_module=software 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=32 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=32 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=1 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val=No 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:44.805 15:08:48 -- accel/accel.sh@20 -- # val= 00:07:44.805 15:08:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # IFS=: 00:07:44.805 15:08:48 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@20 -- # val= 00:07:46.186 15:08:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:49 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:46.186 15:08:49 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:07:46.186 15:08:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.186 00:07:46.186 real 0m1.384s 00:07:46.186 user 0m1.263s 00:07:46.186 sys 0m0.133s 00:07:46.186 15:08:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:46.186 15:08:49 -- common/autotest_common.sh@10 -- # set +x 00:07:46.186 ************************************ 00:07:46.186 END TEST accel_dif_generate_copy 00:07:46.186 ************************************ 00:07:46.186 15:08:49 -- accel/accel.sh@115 -- # [[ y == y ]] 00:07:46.186 15:08:49 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:46.186 15:08:49 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:46.186 15:08:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.186 15:08:49 -- common/autotest_common.sh@10 -- # set +x 00:07:46.186 ************************************ 00:07:46.186 START TEST accel_comp 00:07:46.186 ************************************ 00:07:46.186 15:08:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:46.186 15:08:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:46.186 15:08:50 -- accel/accel.sh@17 -- # local accel_module 00:07:46.186 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.186 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.186 15:08:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:46.186 15:08:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:46.186 15:08:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.186 15:08:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:46.186 15:08:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:46.186 15:08:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.186 15:08:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.186 15:08:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:46.186 15:08:50 -- accel/accel.sh@40 -- # local IFS=, 00:07:46.186 15:08:50 -- accel/accel.sh@41 -- # jq -r . 00:07:46.186 [2024-04-24 15:08:50.086039] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:46.186 [2024-04-24 15:08:50.086097] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid510702 ] 00:07:46.446 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.446 [2024-04-24 15:08:50.167707] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.446 [2024-04-24 15:08:50.248677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=0x1 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=compress 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@23 -- # accel_opc=compress 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=software 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@22 -- # accel_module=software 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=32 00:07:46.446 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.446 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.446 15:08:50 -- accel/accel.sh@20 -- # val=32 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.447 15:08:50 -- accel/accel.sh@20 -- # val=1 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.447 15:08:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.447 15:08:50 -- accel/accel.sh@20 -- # val=No 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.447 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:46.447 15:08:50 -- accel/accel.sh@20 -- # val= 00:07:46.447 15:08:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # IFS=: 00:07:46.447 15:08:50 -- accel/accel.sh@19 -- # read -r var val 00:07:47.828 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.828 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.828 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.828 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.828 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.828 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.828 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.828 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.828 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.828 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.828 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.829 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:47.829 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.829 15:08:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:47.829 15:08:51 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:07:47.829 15:08:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.829 00:07:47.829 real 0m1.414s 00:07:47.829 user 0m1.283s 00:07:47.829 sys 0m0.145s 00:07:47.829 15:08:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:47.829 15:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:47.829 ************************************ 00:07:47.829 END TEST accel_comp 00:07:47.829 ************************************ 00:07:47.829 15:08:51 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:47.829 15:08:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:47.829 15:08:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.829 15:08:51 -- common/autotest_common.sh@10 -- # set +x 00:07:47.829 ************************************ 00:07:47.829 START TEST accel_decomp 00:07:47.829 ************************************ 00:07:47.829 15:08:51 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:47.829 15:08:51 -- accel/accel.sh@16 -- # local accel_opc 00:07:47.829 15:08:51 -- accel/accel.sh@17 -- # local accel_module 00:07:47.829 15:08:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:47.829 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:47.829 15:08:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y 00:07:47.829 15:08:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:47.829 15:08:51 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:47.829 15:08:51 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:47.829 15:08:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.829 15:08:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.829 15:08:51 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:47.829 15:08:51 -- accel/accel.sh@40 -- # local IFS=, 00:07:47.829 15:08:51 -- accel/accel.sh@41 -- # jq -r . 00:07:47.829 [2024-04-24 15:08:51.651059] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:47.829 [2024-04-24 15:08:51.651104] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid510906 ] 00:07:47.829 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.829 [2024-04-24 15:08:51.730773] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.089 [2024-04-24 15:08:51.808545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=0x1 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=decompress 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=software 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@22 -- # accel_module=software 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=32 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=32 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=1 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val=Yes 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:48.089 15:08:51 -- accel/accel.sh@20 -- # val= 00:07:48.089 15:08:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # IFS=: 00:07:48.089 15:08:51 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.470 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.470 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.470 15:08:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:49.470 15:08:53 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:49.470 15:08:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:49.470 00:07:49.470 real 0m1.397s 00:07:49.470 user 0m1.265s 00:07:49.470 sys 0m0.145s 00:07:49.470 15:08:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:49.470 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:07:49.470 ************************************ 00:07:49.470 END TEST accel_decomp 00:07:49.470 ************************************ 00:07:49.471 15:08:53 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:49.471 15:08:53 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:49.471 15:08:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.471 15:08:53 -- common/autotest_common.sh@10 -- # set +x 00:07:49.471 ************************************ 00:07:49.471 START TEST accel_decmop_full 00:07:49.471 ************************************ 00:07:49.471 15:08:53 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:49.471 15:08:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:49.471 15:08:53 -- accel/accel.sh@17 -- # local accel_module 00:07:49.471 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.471 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.471 15:08:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:49.471 15:08:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:49.471 15:08:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:49.471 15:08:53 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:49.471 15:08:53 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:49.471 15:08:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:49.471 15:08:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:49.471 15:08:53 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:49.471 15:08:53 -- accel/accel.sh@40 -- # local IFS=, 00:07:49.471 15:08:53 -- accel/accel.sh@41 -- # jq -r . 00:07:49.471 [2024-04-24 15:08:53.211189] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:49.471 [2024-04-24 15:08:53.211244] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid511108 ] 00:07:49.471 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.471 [2024-04-24 15:08:53.290912] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.471 [2024-04-24 15:08:53.368863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=0x1 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=decompress 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=software 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@22 -- # accel_module=software 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=32 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=32 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=1 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val=Yes 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:49.731 15:08:53 -- accel/accel.sh@20 -- # val= 00:07:49.731 15:08:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # IFS=: 00:07:49.731 15:08:53 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:51.113 15:08:54 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:51.113 15:08:54 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:51.113 00:07:51.113 real 0m1.418s 00:07:51.113 user 0m1.291s 00:07:51.113 sys 0m0.140s 00:07:51.113 15:08:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:51.113 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:07:51.113 ************************************ 00:07:51.113 END TEST accel_decmop_full 00:07:51.113 ************************************ 00:07:51.113 15:08:54 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:51.113 15:08:54 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:51.113 15:08:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.113 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:07:51.113 ************************************ 00:07:51.113 START TEST accel_decomp_mcore 00:07:51.113 ************************************ 00:07:51.113 15:08:54 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:51.113 15:08:54 -- accel/accel.sh@16 -- # local accel_opc 00:07:51.113 15:08:54 -- accel/accel.sh@17 -- # local accel_module 00:07:51.113 15:08:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:51.113 15:08:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.113 15:08:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:51.113 15:08:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:51.113 15:08:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.113 15:08:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.113 15:08:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:51.113 15:08:54 -- accel/accel.sh@40 -- # local IFS=, 00:07:51.113 15:08:54 -- accel/accel.sh@41 -- # jq -r . 00:07:51.113 [2024-04-24 15:08:54.776462] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:51.113 [2024-04-24 15:08:54.776524] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid511319 ] 00:07:51.113 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.113 [2024-04-24 15:08:54.857066] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:51.113 [2024-04-24 15:08:54.935434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:51.113 [2024-04-24 15:08:54.935521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:51.113 [2024-04-24 15:08:54.935558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:51.113 [2024-04-24 15:08:54.935561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=0xf 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=decompress 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=software 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@22 -- # accel_module=software 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=32 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=32 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=1 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val=Yes 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.113 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.113 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.113 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:51.114 15:08:54 -- accel/accel.sh@20 -- # val= 00:07:51.114 15:08:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.114 15:08:54 -- accel/accel.sh@19 -- # IFS=: 00:07:51.114 15:08:54 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.495 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.495 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.495 15:08:56 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:52.495 15:08:56 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:52.495 15:08:56 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:52.495 00:07:52.495 real 0m1.391s 00:07:52.495 user 0m4.604s 00:07:52.495 sys 0m0.141s 00:07:52.495 15:08:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:52.495 15:08:56 -- common/autotest_common.sh@10 -- # set +x 00:07:52.495 ************************************ 00:07:52.495 END TEST accel_decomp_mcore 00:07:52.495 ************************************ 00:07:52.496 15:08:56 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.496 15:08:56 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:52.496 15:08:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.496 15:08:56 -- common/autotest_common.sh@10 -- # set +x 00:07:52.496 ************************************ 00:07:52.496 START TEST accel_decomp_full_mcore 00:07:52.496 ************************************ 00:07:52.496 15:08:56 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.496 15:08:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:52.496 15:08:56 -- accel/accel.sh@17 -- # local accel_module 00:07:52.496 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.496 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.496 15:08:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.496 15:08:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:52.496 15:08:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:52.496 15:08:56 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:52.496 15:08:56 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:52.496 15:08:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:52.496 15:08:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:52.496 15:08:56 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:52.496 15:08:56 -- accel/accel.sh@40 -- # local IFS=, 00:07:52.496 15:08:56 -- accel/accel.sh@41 -- # jq -r . 00:07:52.496 [2024-04-24 15:08:56.328953] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:52.496 [2024-04-24 15:08:56.329008] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid511604 ] 00:07:52.496 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.756 [2024-04-24 15:08:56.411135] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:52.756 [2024-04-24 15:08:56.492401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:52.756 [2024-04-24 15:08:56.492493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:52.756 [2024-04-24 15:08:56.492546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:52.756 [2024-04-24 15:08:56.492548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=0xf 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=decompress 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=software 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@22 -- # accel_module=software 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=32 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=32 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=1 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val=Yes 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:52.756 15:08:56 -- accel/accel.sh@20 -- # val= 00:07:52.756 15:08:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # IFS=: 00:07:52.756 15:08:56 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@20 -- # val= 00:07:54.139 15:08:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:54.139 15:08:57 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:54.139 15:08:57 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:54.139 00:07:54.139 real 0m1.438s 00:07:54.139 user 0m4.693s 00:07:54.139 sys 0m0.161s 00:07:54.139 15:08:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:54.139 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:07:54.139 ************************************ 00:07:54.139 END TEST accel_decomp_full_mcore 00:07:54.139 ************************************ 00:07:54.139 15:08:57 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:54.139 15:08:57 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:54.139 15:08:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.139 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:07:54.139 ************************************ 00:07:54.139 START TEST accel_decomp_mthread 00:07:54.139 ************************************ 00:07:54.139 15:08:57 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:54.139 15:08:57 -- accel/accel.sh@16 -- # local accel_opc 00:07:54.139 15:08:57 -- accel/accel.sh@17 -- # local accel_module 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # IFS=: 00:07:54.139 15:08:57 -- accel/accel.sh@19 -- # read -r var val 00:07:54.139 15:08:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:54.139 15:08:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:54.139 15:08:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.139 15:08:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:54.139 15:08:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:54.139 15:08:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.139 15:08:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.139 15:08:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:54.139 15:08:57 -- accel/accel.sh@40 -- # local IFS=, 00:07:54.139 15:08:57 -- accel/accel.sh@41 -- # jq -r . 00:07:54.139 [2024-04-24 15:08:57.942935] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:54.139 [2024-04-24 15:08:57.942990] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid511887 ] 00:07:54.139 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.139 [2024-04-24 15:08:58.023547] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.399 [2024-04-24 15:08:58.101838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val=0x1 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val=decompress 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.399 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.399 15:08:58 -- accel/accel.sh@20 -- # val=software 00:07:54.399 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@22 -- # accel_module=software 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val=32 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val=32 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val=2 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val=Yes 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:54.400 15:08:58 -- accel/accel.sh@20 -- # val= 00:07:54.400 15:08:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # IFS=: 00:07:54.400 15:08:58 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:55.783 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.783 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.783 15:08:59 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:55.783 15:08:59 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:55.783 15:08:59 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:55.783 00:07:55.783 real 0m1.418s 00:07:55.784 user 0m1.285s 00:07:55.784 sys 0m0.145s 00:07:55.784 15:08:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:55.784 15:08:59 -- common/autotest_common.sh@10 -- # set +x 00:07:55.784 ************************************ 00:07:55.784 END TEST accel_decomp_mthread 00:07:55.784 ************************************ 00:07:55.784 15:08:59 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:55.784 15:08:59 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:55.784 15:08:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.784 15:08:59 -- common/autotest_common.sh@10 -- # set +x 00:07:55.784 ************************************ 00:07:55.784 START TEST accel_deomp_full_mthread 00:07:55.784 ************************************ 00:07:55.784 15:08:59 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:55.784 15:08:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:55.784 15:08:59 -- accel/accel.sh@17 -- # local accel_module 00:07:55.784 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:55.784 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:55.784 15:08:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:55.784 15:08:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:55.784 15:08:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.784 15:08:59 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:55.784 15:08:59 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:55.784 15:08:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.784 15:08:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.784 15:08:59 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:55.784 15:08:59 -- accel/accel.sh@40 -- # local IFS=, 00:07:55.784 15:08:59 -- accel/accel.sh@41 -- # jq -r . 00:07:55.784 [2024-04-24 15:08:59.541966] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:55.784 [2024-04-24 15:08:59.542046] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid512089 ] 00:07:55.784 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.784 [2024-04-24 15:08:59.621772] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.044 [2024-04-24 15:08:59.701210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=0x1 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=decompress 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=software 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@22 -- # accel_module=software 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/bib 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=32 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=32 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=2 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val=Yes 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:56.044 15:08:59 -- accel/accel.sh@20 -- # val= 00:07:56.044 15:08:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # IFS=: 00:07:56.044 15:08:59 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@20 -- # val= 00:07:57.426 15:09:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # IFS=: 00:07:57.426 15:09:00 -- accel/accel.sh@19 -- # read -r var val 00:07:57.426 15:09:00 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:57.426 15:09:00 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:57.426 15:09:00 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:57.426 00:07:57.426 real 0m1.435s 00:07:57.426 user 0m1.295s 00:07:57.426 sys 0m0.151s 00:07:57.426 15:09:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:57.426 15:09:00 -- common/autotest_common.sh@10 -- # set +x 00:07:57.426 ************************************ 00:07:57.426 END TEST accel_deomp_full_mthread 00:07:57.426 ************************************ 00:07:57.426 15:09:00 -- accel/accel.sh@124 -- # [[ n == y ]] 00:07:57.426 15:09:00 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:57.426 15:09:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:57.426 15:09:00 -- accel/accel.sh@137 -- # build_accel_config 00:07:57.426 15:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.426 15:09:00 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:57.426 15:09:00 -- common/autotest_common.sh@10 -- # set +x 00:07:57.426 15:09:00 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:57.426 15:09:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:57.426 15:09:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:57.426 15:09:00 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:57.426 15:09:00 -- accel/accel.sh@40 -- # local IFS=, 00:07:57.426 15:09:00 -- accel/accel.sh@41 -- # jq -r . 00:07:57.426 ************************************ 00:07:57.426 START TEST accel_dif_functional_tests 00:07:57.426 ************************************ 00:07:57.426 15:09:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:57.426 [2024-04-24 15:09:01.141358] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:57.426 [2024-04-24 15:09:01.141399] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid512377 ] 00:07:57.426 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.426 [2024-04-24 15:09:01.221122] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:57.426 [2024-04-24 15:09:01.300899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:57.426 [2024-04-24 15:09:01.300954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:57.426 [2024-04-24 15:09:01.300956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.686 00:07:57.686 00:07:57.686 CUnit - A unit testing framework for C - Version 2.1-3 00:07:57.686 http://cunit.sourceforge.net/ 00:07:57.686 00:07:57.686 00:07:57.686 Suite: accel_dif 00:07:57.686 Test: verify: DIF generated, GUARD check ...passed 00:07:57.686 Test: verify: DIF generated, APPTAG check ...passed 00:07:57.686 Test: verify: DIF generated, REFTAG check ...passed 00:07:57.686 Test: verify: DIF not generated, GUARD check ...[2024-04-24 15:09:01.378236] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:57.686 [2024-04-24 15:09:01.378286] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:57.686 passed 00:07:57.686 Test: verify: DIF not generated, APPTAG check ...[2024-04-24 15:09:01.378319] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:57.686 [2024-04-24 15:09:01.378336] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:57.686 passed 00:07:57.686 Test: verify: DIF not generated, REFTAG check ...[2024-04-24 15:09:01.378359] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:57.686 [2024-04-24 15:09:01.378377] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:57.686 passed 00:07:57.686 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:57.686 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-24 15:09:01.378422] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:57.686 passed 00:07:57.686 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:57.686 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:57.686 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:57.686 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-24 15:09:01.378535] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:57.686 passed 00:07:57.686 Test: generate copy: DIF generated, GUARD check ...passed 00:07:57.686 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:57.686 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:57.686 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:57.686 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:57.686 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:57.686 Test: generate copy: iovecs-len validate ...[2024-04-24 15:09:01.378707] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:57.686 passed 00:07:57.686 Test: generate copy: buffer alignment validate ...passed 00:07:57.686 00:07:57.686 Run Summary: Type Total Ran Passed Failed Inactive 00:07:57.686 suites 1 1 n/a 0 0 00:07:57.686 tests 20 20 20 0 0 00:07:57.686 asserts 204 204 204 0 n/a 00:07:57.686 00:07:57.686 Elapsed time = 0.002 seconds 00:07:57.686 00:07:57.686 real 0m0.479s 00:07:57.686 user 0m0.673s 00:07:57.686 sys 0m0.166s 00:07:57.686 15:09:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:57.686 15:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:57.686 ************************************ 00:07:57.686 END TEST accel_dif_functional_tests 00:07:57.686 ************************************ 00:07:57.945 00:07:57.945 real 0m35.619s 00:07:57.945 user 0m36.742s 00:07:57.945 sys 0m6.518s 00:07:57.945 15:09:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:57.945 15:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:57.945 ************************************ 00:07:57.945 END TEST accel 00:07:57.945 ************************************ 00:07:57.945 15:09:01 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:57.945 15:09:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:57.945 15:09:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.945 15:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:57.945 ************************************ 00:07:57.945 START TEST accel_rpc 00:07:57.945 ************************************ 00:07:57.945 15:09:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:58.205 * Looking for test storage... 00:07:58.205 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/accel 00:07:58.205 15:09:01 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:58.205 15:09:01 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=512659 00:07:58.205 15:09:01 -- accel/accel_rpc.sh@15 -- # waitforlisten 512659 00:07:58.205 15:09:01 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:58.205 15:09:01 -- common/autotest_common.sh@817 -- # '[' -z 512659 ']' 00:07:58.205 15:09:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:58.205 15:09:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:58.205 15:09:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:58.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:58.205 15:09:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:58.205 15:09:01 -- common/autotest_common.sh@10 -- # set +x 00:07:58.205 [2024-04-24 15:09:01.960360] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:07:58.205 [2024-04-24 15:09:01.960421] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid512659 ] 00:07:58.206 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.206 [2024-04-24 15:09:02.041153] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:58.206 [2024-04-24 15:09:02.117501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.146 15:09:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:59.146 15:09:02 -- common/autotest_common.sh@850 -- # return 0 00:07:59.146 15:09:02 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:59.146 15:09:02 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:59.146 15:09:02 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:59.146 15:09:02 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:59.146 15:09:02 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:59.146 15:09:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:59.146 15:09:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:59.146 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:07:59.146 ************************************ 00:07:59.146 START TEST accel_assign_opcode 00:07:59.146 ************************************ 00:07:59.147 15:09:02 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:07:59.147 15:09:02 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:59.147 15:09:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.147 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:07:59.147 [2024-04-24 15:09:02.927930] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:59.147 15:09:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.147 15:09:02 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:59.147 15:09:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.147 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:07:59.147 [2024-04-24 15:09:02.939953] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:59.147 15:09:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.147 15:09:02 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:59.147 15:09:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.147 15:09:02 -- common/autotest_common.sh@10 -- # set +x 00:07:59.407 15:09:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.407 15:09:03 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:59.407 15:09:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:59.407 15:09:03 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:59.407 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:59.407 15:09:03 -- accel/accel_rpc.sh@42 -- # grep software 00:07:59.407 15:09:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:59.407 software 00:07:59.407 00:07:59.407 real 0m0.273s 00:07:59.407 user 0m0.052s 00:07:59.407 sys 0m0.008s 00:07:59.407 15:09:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:59.407 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:59.407 ************************************ 00:07:59.407 END TEST accel_assign_opcode 00:07:59.407 ************************************ 00:07:59.407 15:09:03 -- accel/accel_rpc.sh@55 -- # killprocess 512659 00:07:59.407 15:09:03 -- common/autotest_common.sh@936 -- # '[' -z 512659 ']' 00:07:59.407 15:09:03 -- common/autotest_common.sh@940 -- # kill -0 512659 00:07:59.407 15:09:03 -- common/autotest_common.sh@941 -- # uname 00:07:59.407 15:09:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:59.407 15:09:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 512659 00:07:59.407 15:09:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:59.407 15:09:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:59.407 15:09:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 512659' 00:07:59.407 killing process with pid 512659 00:07:59.407 15:09:03 -- common/autotest_common.sh@955 -- # kill 512659 00:07:59.407 15:09:03 -- common/autotest_common.sh@960 -- # wait 512659 00:07:59.976 00:07:59.976 real 0m1.853s 00:07:59.976 user 0m1.874s 00:07:59.976 sys 0m0.599s 00:07:59.976 15:09:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:59.976 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:59.977 ************************************ 00:07:59.977 END TEST accel_rpc 00:07:59.977 ************************************ 00:07:59.977 15:09:03 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/cmdline.sh 00:07:59.977 15:09:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:59.977 15:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:59.977 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:59.977 ************************************ 00:07:59.977 START TEST app_cmdline 00:07:59.977 ************************************ 00:07:59.977 15:09:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/cmdline.sh 00:08:00.236 * Looking for test storage... 00:08:00.236 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:08:00.236 15:09:03 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:00.236 15:09:03 -- app/cmdline.sh@17 -- # spdk_tgt_pid=512936 00:08:00.236 15:09:03 -- app/cmdline.sh@18 -- # waitforlisten 512936 00:08:00.236 15:09:03 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:00.236 15:09:03 -- common/autotest_common.sh@817 -- # '[' -z 512936 ']' 00:08:00.236 15:09:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:00.236 15:09:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:00.236 15:09:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:00.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:00.236 15:09:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:00.236 15:09:03 -- common/autotest_common.sh@10 -- # set +x 00:08:00.236 [2024-04-24 15:09:04.014301] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:08:00.236 [2024-04-24 15:09:04.014360] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid512936 ] 00:08:00.236 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.236 [2024-04-24 15:09:04.096081] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:00.496 [2024-04-24 15:09:04.172836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:01.065 15:09:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:01.065 15:09:04 -- common/autotest_common.sh@850 -- # return 0 00:08:01.065 15:09:04 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:01.065 { 00:08:01.065 "version": "SPDK v24.05-pre git sha1 3f2c89791", 00:08:01.065 "fields": { 00:08:01.065 "major": 24, 00:08:01.065 "minor": 5, 00:08:01.065 "patch": 0, 00:08:01.065 "suffix": "-pre", 00:08:01.065 "commit": "3f2c89791" 00:08:01.065 } 00:08:01.065 } 00:08:01.065 15:09:04 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:01.065 15:09:04 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:01.065 15:09:04 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:01.325 15:09:04 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:01.325 15:09:04 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:01.325 15:09:04 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:01.325 15:09:04 -- app/cmdline.sh@26 -- # sort 00:08:01.325 15:09:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:01.325 15:09:04 -- common/autotest_common.sh@10 -- # set +x 00:08:01.325 15:09:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:01.325 15:09:05 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:01.325 15:09:05 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:01.325 15:09:05 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:01.325 15:09:05 -- common/autotest_common.sh@638 -- # local es=0 00:08:01.325 15:09:05 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:01.325 15:09:05 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:08:01.325 15:09:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:01.325 15:09:05 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:08:01.325 15:09:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:01.325 15:09:05 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:08:01.325 15:09:05 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:01.325 15:09:05 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:08:01.325 15:09:05 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:08:01.325 15:09:05 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:01.325 request: 00:08:01.325 { 00:08:01.325 "method": "env_dpdk_get_mem_stats", 00:08:01.325 "req_id": 1 00:08:01.325 } 00:08:01.325 Got JSON-RPC error response 00:08:01.325 response: 00:08:01.325 { 00:08:01.325 "code": -32601, 00:08:01.325 "message": "Method not found" 00:08:01.325 } 00:08:01.325 15:09:05 -- common/autotest_common.sh@641 -- # es=1 00:08:01.325 15:09:05 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:01.325 15:09:05 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:01.325 15:09:05 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:01.325 15:09:05 -- app/cmdline.sh@1 -- # killprocess 512936 00:08:01.325 15:09:05 -- common/autotest_common.sh@936 -- # '[' -z 512936 ']' 00:08:01.325 15:09:05 -- common/autotest_common.sh@940 -- # kill -0 512936 00:08:01.325 15:09:05 -- common/autotest_common.sh@941 -- # uname 00:08:01.325 15:09:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:01.325 15:09:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 512936 00:08:01.585 15:09:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:01.585 15:09:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:01.585 15:09:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 512936' 00:08:01.585 killing process with pid 512936 00:08:01.585 15:09:05 -- common/autotest_common.sh@955 -- # kill 512936 00:08:01.585 15:09:05 -- common/autotest_common.sh@960 -- # wait 512936 00:08:01.891 00:08:01.891 real 0m1.727s 00:08:01.891 user 0m1.949s 00:08:01.891 sys 0m0.522s 00:08:01.891 15:09:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:01.891 15:09:05 -- common/autotest_common.sh@10 -- # set +x 00:08:01.891 ************************************ 00:08:01.891 END TEST app_cmdline 00:08:01.891 ************************************ 00:08:01.891 15:09:05 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/version.sh 00:08:01.891 15:09:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:01.891 15:09:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:01.891 15:09:05 -- common/autotest_common.sh@10 -- # set +x 00:08:02.151 ************************************ 00:08:02.151 START TEST version 00:08:02.151 ************************************ 00:08:02.151 15:09:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/version.sh 00:08:02.151 * Looking for test storage... 00:08:02.151 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:08:02.151 15:09:05 -- app/version.sh@17 -- # get_header_version major 00:08:02.151 15:09:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:08:02.151 15:09:05 -- app/version.sh@14 -- # cut -f2 00:08:02.151 15:09:05 -- app/version.sh@14 -- # tr -d '"' 00:08:02.151 15:09:05 -- app/version.sh@17 -- # major=24 00:08:02.151 15:09:05 -- app/version.sh@18 -- # get_header_version minor 00:08:02.151 15:09:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:08:02.151 15:09:05 -- app/version.sh@14 -- # cut -f2 00:08:02.151 15:09:05 -- app/version.sh@14 -- # tr -d '"' 00:08:02.151 15:09:05 -- app/version.sh@18 -- # minor=5 00:08:02.151 15:09:05 -- app/version.sh@19 -- # get_header_version patch 00:08:02.151 15:09:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:08:02.151 15:09:05 -- app/version.sh@14 -- # tr -d '"' 00:08:02.151 15:09:05 -- app/version.sh@14 -- # cut -f2 00:08:02.151 15:09:05 -- app/version.sh@19 -- # patch=0 00:08:02.151 15:09:05 -- app/version.sh@20 -- # get_header_version suffix 00:08:02.151 15:09:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/version.h 00:08:02.151 15:09:05 -- app/version.sh@14 -- # tr -d '"' 00:08:02.151 15:09:05 -- app/version.sh@14 -- # cut -f2 00:08:02.151 15:09:05 -- app/version.sh@20 -- # suffix=-pre 00:08:02.152 15:09:05 -- app/version.sh@22 -- # version=24.5 00:08:02.152 15:09:05 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:02.152 15:09:05 -- app/version.sh@28 -- # version=24.5rc0 00:08:02.152 15:09:05 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:08:02.152 15:09:05 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:02.152 15:09:05 -- app/version.sh@30 -- # py_version=24.5rc0 00:08:02.152 15:09:05 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:08:02.152 00:08:02.152 real 0m0.181s 00:08:02.152 user 0m0.084s 00:08:02.152 sys 0m0.136s 00:08:02.152 15:09:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:02.152 15:09:05 -- common/autotest_common.sh@10 -- # set +x 00:08:02.152 ************************************ 00:08:02.152 END TEST version 00:08:02.152 ************************************ 00:08:02.152 15:09:06 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:08:02.152 15:09:06 -- spdk/autotest.sh@194 -- # uname -s 00:08:02.152 15:09:06 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:08:02.152 15:09:06 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:02.152 15:09:06 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:02.152 15:09:06 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:08:02.152 15:09:06 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:08:02.152 15:09:06 -- spdk/autotest.sh@258 -- # timing_exit lib 00:08:02.152 15:09:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:02.152 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:02.411 15:09:06 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:08:02.411 15:09:06 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:08:02.411 15:09:06 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:08:02.411 15:09:06 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:08:02.411 15:09:06 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:08:02.411 15:09:06 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:02.411 15:09:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:02.411 15:09:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:02.411 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:02.411 ************************************ 00:08:02.411 START TEST nvmf_rdma 00:08:02.411 ************************************ 00:08:02.411 15:09:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:02.681 * Looking for test storage... 00:08:02.681 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:08:02.681 15:09:06 -- nvmf/common.sh@7 -- # uname -s 00:08:02.681 15:09:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:02.681 15:09:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:02.681 15:09:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:02.681 15:09:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:02.681 15:09:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:02.681 15:09:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:02.681 15:09:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:02.681 15:09:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:02.681 15:09:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:02.681 15:09:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:02.681 15:09:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:08:02.681 15:09:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:08:02.681 15:09:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:02.681 15:09:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:02.681 15:09:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:02.681 15:09:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:02.681 15:09:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:02.681 15:09:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:02.681 15:09:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:02.681 15:09:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:02.681 15:09:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.681 15:09:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.681 15:09:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.681 15:09:06 -- paths/export.sh@5 -- # export PATH 00:08:02.681 15:09:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.681 15:09:06 -- nvmf/common.sh@47 -- # : 0 00:08:02.681 15:09:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:02.681 15:09:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:02.681 15:09:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:02.681 15:09:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:02.681 15:09:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:02.681 15:09:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:02.681 15:09:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:02.681 15:09:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:02.681 15:09:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:02.681 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:02.681 15:09:06 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:02.681 15:09:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:02.681 15:09:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:02.681 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:02.681 ************************************ 00:08:02.681 START TEST nvmf_example 00:08:02.681 ************************************ 00:08:02.681 15:09:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:02.951 * Looking for test storage... 00:08:02.951 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:02.951 15:09:06 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:08:02.951 15:09:06 -- nvmf/common.sh@7 -- # uname -s 00:08:02.951 15:09:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:02.951 15:09:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:02.951 15:09:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:02.951 15:09:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:02.951 15:09:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:02.951 15:09:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:02.951 15:09:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:02.951 15:09:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:02.951 15:09:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:02.951 15:09:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:02.951 15:09:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:08:02.951 15:09:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:08:02.951 15:09:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:02.951 15:09:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:02.951 15:09:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:02.951 15:09:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:02.951 15:09:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:02.951 15:09:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:02.951 15:09:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:02.951 15:09:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:02.951 15:09:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.951 15:09:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.951 15:09:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.951 15:09:06 -- paths/export.sh@5 -- # export PATH 00:08:02.951 15:09:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:02.952 15:09:06 -- nvmf/common.sh@47 -- # : 0 00:08:02.952 15:09:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:02.952 15:09:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:02.952 15:09:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:02.952 15:09:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:02.952 15:09:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:02.952 15:09:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:02.952 15:09:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:02.952 15:09:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:02.952 15:09:06 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:02.952 15:09:06 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:02.952 15:09:06 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:02.952 15:09:06 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:02.952 15:09:06 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:02.952 15:09:06 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:02.952 15:09:06 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:02.952 15:09:06 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:02.952 15:09:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:02.952 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:02.952 15:09:06 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:02.952 15:09:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:02.952 15:09:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:02.952 15:09:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:02.952 15:09:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:02.952 15:09:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:02.952 15:09:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:02.952 15:09:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:02.952 15:09:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:02.952 15:09:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:02.952 15:09:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:02.952 15:09:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:02.952 15:09:06 -- common/autotest_common.sh@10 -- # set +x 00:08:09.531 15:09:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:09.531 15:09:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:09.531 15:09:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:09.531 15:09:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:09.531 15:09:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:09.531 15:09:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:09.531 15:09:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:09.532 15:09:12 -- nvmf/common.sh@295 -- # net_devs=() 00:08:09.532 15:09:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:09.532 15:09:12 -- nvmf/common.sh@296 -- # e810=() 00:08:09.532 15:09:12 -- nvmf/common.sh@296 -- # local -ga e810 00:08:09.532 15:09:12 -- nvmf/common.sh@297 -- # x722=() 00:08:09.532 15:09:12 -- nvmf/common.sh@297 -- # local -ga x722 00:08:09.532 15:09:12 -- nvmf/common.sh@298 -- # mlx=() 00:08:09.532 15:09:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:09.532 15:09:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:09.532 15:09:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:08:09.532 Found 0000:18:00.0 (0x8086 - 0x1592) 00:08:09.532 15:09:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:09.532 15:09:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:08:09.532 Found 0000:18:00.1 (0x8086 - 0x1592) 00:08:09.532 15:09:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:09.532 15:09:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@377 -- # modinfo irdma 00:08:09.532 15:09:12 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:08:09.532 15:09:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:09.532 15:09:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:09.532 15:09:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:08:09.532 Found net devices under 0000:18:00.0: cvl_0_0 00:08:09.532 15:09:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:09.532 15:09:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:09.532 15:09:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:08:09.532 Found net devices under 0000:18:00.1: cvl_0_1 00:08:09.532 15:09:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:09.532 15:09:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:09.532 15:09:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:09.532 15:09:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:09.532 15:09:12 -- nvmf/common.sh@58 -- # uname 00:08:09.532 15:09:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:09.532 15:09:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:09.532 15:09:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:09.532 15:09:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:09.532 15:09:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:09.532 15:09:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:09.532 15:09:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:09.532 15:09:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:09.532 15:09:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:09.532 15:09:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:09.532 15:09:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:09.532 15:09:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:09.532 15:09:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:09.532 15:09:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:09.532 15:09:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:09.532 15:09:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:09.532 15:09:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:09.532 15:09:12 -- nvmf/common.sh@105 -- # continue 2 00:08:09.532 15:09:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.532 15:09:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:09.532 15:09:12 -- nvmf/common.sh@105 -- # continue 2 00:08:09.532 15:09:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:09.532 15:09:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:08:09.532 15:09:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:09.532 15:09:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:09.532 15:09:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:08:09.532 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:09.532 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:08:09.532 altname enp24s0f0np0 00:08:09.532 altname ens785f0np0 00:08:09.532 inet 192.168.100.8/24 scope global cvl_0_0 00:08:09.532 valid_lft forever preferred_lft forever 00:08:09.532 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:08:09.532 valid_lft forever preferred_lft forever 00:08:09.532 15:09:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:09.532 15:09:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:08:09.532 15:09:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:09.532 15:09:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:09.532 15:09:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:09.532 15:09:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:08:09.532 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:09.532 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:08:09.532 altname enp24s0f1np1 00:08:09.532 altname ens785f1np1 00:08:09.532 inet 192.168.100.9/24 scope global cvl_0_1 00:08:09.532 valid_lft forever preferred_lft forever 00:08:09.532 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:08:09.532 valid_lft forever preferred_lft forever 00:08:09.532 15:09:12 -- nvmf/common.sh@411 -- # return 0 00:08:09.532 15:09:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:09.532 15:09:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:09.532 15:09:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:09.532 15:09:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:09.532 15:09:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:09.532 15:09:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:09.532 15:09:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:09.532 15:09:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:09.532 15:09:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:09.532 15:09:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:09.532 15:09:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:09.532 15:09:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.532 15:09:13 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:09.532 15:09:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.532 15:09:13 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:09.532 15:09:13 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:09.532 15:09:13 -- nvmf/common.sh@105 -- # continue 2 00:08:09.532 15:09:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:09.532 15:09:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:09.533 15:09:13 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:09.533 15:09:13 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:09.533 15:09:13 -- nvmf/common.sh@105 -- # continue 2 00:08:09.533 15:09:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:09.533 15:09:13 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:08:09.533 15:09:13 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:09.533 15:09:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:09.533 15:09:13 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:08:09.533 15:09:13 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:09.533 15:09:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:09.533 15:09:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:09.533 192.168.100.9' 00:08:09.533 15:09:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:09.533 192.168.100.9' 00:08:09.533 15:09:13 -- nvmf/common.sh@446 -- # head -n 1 00:08:09.533 15:09:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:09.533 15:09:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:09.533 192.168.100.9' 00:08:09.533 15:09:13 -- nvmf/common.sh@447 -- # tail -n +2 00:08:09.533 15:09:13 -- nvmf/common.sh@447 -- # head -n 1 00:08:09.533 15:09:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:09.533 15:09:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:09.533 15:09:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:09.533 15:09:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:09.533 15:09:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:09.533 15:09:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:09.533 15:09:13 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:09.533 15:09:13 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:09.533 15:09:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:09.533 15:09:13 -- common/autotest_common.sh@10 -- # set +x 00:08:09.533 15:09:13 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:08:09.533 15:09:13 -- target/nvmf_example.sh@34 -- # nvmfpid=517000 00:08:09.533 15:09:13 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:09.533 15:09:13 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:09.533 15:09:13 -- target/nvmf_example.sh@36 -- # waitforlisten 517000 00:08:09.533 15:09:13 -- common/autotest_common.sh@817 -- # '[' -z 517000 ']' 00:08:09.533 15:09:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:09.533 15:09:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:09.533 15:09:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:09.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:09.533 15:09:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:09.533 15:09:13 -- common/autotest_common.sh@10 -- # set +x 00:08:09.533 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.103 15:09:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:10.103 15:09:13 -- common/autotest_common.sh@850 -- # return 0 00:08:10.103 15:09:13 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:10.103 15:09:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:10.103 15:09:13 -- common/autotest_common.sh@10 -- # set +x 00:08:10.103 15:09:13 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:10.103 15:09:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.103 15:09:13 -- common/autotest_common.sh@10 -- # set +x 00:08:10.363 15:09:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.363 15:09:14 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:10.363 15:09:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.363 15:09:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.363 15:09:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.363 15:09:14 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:10.363 15:09:14 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:10.363 15:09:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.363 15:09:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.363 15:09:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.363 15:09:14 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:10.363 15:09:14 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:10.363 15:09:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.363 15:09:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.363 15:09:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.363 15:09:14 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:10.363 15:09:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.363 15:09:14 -- common/autotest_common.sh@10 -- # set +x 00:08:10.363 15:09:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.363 15:09:14 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:10.363 15:09:14 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:10.363 EAL: No free 2048 kB hugepages reported on node 1 00:08:22.586 Initializing NVMe Controllers 00:08:22.586 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:08:22.586 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:22.586 Initialization complete. Launching workers. 00:08:22.586 ======================================================== 00:08:22.586 Latency(us) 00:08:22.586 Device Information : IOPS MiB/s Average min max 00:08:22.586 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 25678.70 100.31 2492.30 500.25 16165.90 00:08:22.586 ======================================================== 00:08:22.586 Total : 25678.70 100.31 2492.30 500.25 16165.90 00:08:22.586 00:08:22.586 15:09:25 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:22.586 15:09:25 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:22.586 15:09:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:22.586 15:09:25 -- nvmf/common.sh@117 -- # sync 00:08:22.586 15:09:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:22.586 15:09:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:22.586 15:09:25 -- nvmf/common.sh@120 -- # set +e 00:08:22.586 15:09:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:22.586 15:09:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:22.586 rmmod nvme_rdma 00:08:22.586 rmmod nvme_fabrics 00:08:22.586 15:09:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:22.586 15:09:25 -- nvmf/common.sh@124 -- # set -e 00:08:22.586 15:09:25 -- nvmf/common.sh@125 -- # return 0 00:08:22.586 15:09:25 -- nvmf/common.sh@478 -- # '[' -n 517000 ']' 00:08:22.586 15:09:25 -- nvmf/common.sh@479 -- # killprocess 517000 00:08:22.586 15:09:25 -- common/autotest_common.sh@936 -- # '[' -z 517000 ']' 00:08:22.586 15:09:25 -- common/autotest_common.sh@940 -- # kill -0 517000 00:08:22.586 15:09:25 -- common/autotest_common.sh@941 -- # uname 00:08:22.586 15:09:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:22.586 15:09:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 517000 00:08:22.586 15:09:25 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:22.586 15:09:25 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:22.586 15:09:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 517000' 00:08:22.586 killing process with pid 517000 00:08:22.586 15:09:25 -- common/autotest_common.sh@955 -- # kill 517000 00:08:22.586 15:09:25 -- common/autotest_common.sh@960 -- # wait 517000 00:08:22.586 [2024-04-24 15:09:25.424916] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:22.586 nvmf threads initialize successfully 00:08:22.586 bdev subsystem init successfully 00:08:22.586 created a nvmf target service 00:08:22.586 create targets's poll groups done 00:08:22.586 all subsystems of target started 00:08:22.586 nvmf target is running 00:08:22.586 all subsystems of target stopped 00:08:22.586 destroy targets's poll groups done 00:08:22.586 destroyed the nvmf target service 00:08:22.586 bdev subsystem finish successfully 00:08:22.586 nvmf threads destroy successfully 00:08:22.586 15:09:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:22.586 15:09:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:22.586 15:09:25 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:22.586 15:09:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:22.586 15:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:22.586 00:08:22.586 real 0m19.149s 00:08:22.586 user 0m51.123s 00:08:22.586 sys 0m5.460s 00:08:22.586 15:09:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:22.586 15:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:22.586 ************************************ 00:08:22.586 END TEST nvmf_example 00:08:22.586 ************************************ 00:08:22.587 15:09:25 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:22.587 15:09:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:22.587 15:09:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.587 15:09:25 -- common/autotest_common.sh@10 -- # set +x 00:08:22.587 ************************************ 00:08:22.587 START TEST nvmf_filesystem 00:08:22.587 ************************************ 00:08:22.587 15:09:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:22.587 * Looking for test storage... 00:08:22.587 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.587 15:09:25 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh 00:08:22.587 15:09:25 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:22.587 15:09:25 -- common/autotest_common.sh@34 -- # set -e 00:08:22.587 15:09:25 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:22.587 15:09:25 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:22.587 15:09:25 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output ']' 00:08:22.587 15:09:25 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:22.587 15:09:25 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh 00:08:22.587 15:09:25 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:22.587 15:09:25 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:22.587 15:09:25 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:22.587 15:09:25 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:22.587 15:09:25 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:22.587 15:09:25 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:22.587 15:09:25 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:22.587 15:09:25 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:22.587 15:09:25 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:22.587 15:09:25 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:22.587 15:09:25 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:22.587 15:09:25 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:22.587 15:09:25 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:22.587 15:09:25 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:22.587 15:09:25 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:22.587 15:09:25 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:22.587 15:09:25 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:08:22.587 15:09:25 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:22.587 15:09:25 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:22.587 15:09:25 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:22.587 15:09:25 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:22.587 15:09:25 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:22.587 15:09:25 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:22.587 15:09:25 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:22.587 15:09:25 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:22.587 15:09:25 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:22.587 15:09:25 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:22.587 15:09:25 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:22.587 15:09:25 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:22.587 15:09:25 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:22.587 15:09:25 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:22.587 15:09:25 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:22.587 15:09:25 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:08:22.587 15:09:25 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:22.587 15:09:25 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:22.587 15:09:25 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:22.587 15:09:25 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:22.587 15:09:25 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:22.587 15:09:25 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:22.587 15:09:25 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:22.587 15:09:25 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:22.587 15:09:25 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:22.587 15:09:25 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:22.587 15:09:25 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:22.587 15:09:25 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:22.587 15:09:25 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:08:22.587 15:09:25 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:22.587 15:09:25 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:08:22.587 15:09:25 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:08:22.587 15:09:25 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:08:22.587 15:09:25 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:08:22.587 15:09:25 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:08:22.587 15:09:25 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:08:22.587 15:09:25 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:08:22.587 15:09:25 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:08:22.587 15:09:25 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:08:22.587 15:09:25 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:08:22.587 15:09:25 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:08:22.587 15:09:25 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:08:22.587 15:09:25 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:08:22.587 15:09:25 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:22.587 15:09:25 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:08:22.587 15:09:25 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:08:22.587 15:09:25 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:08:22.587 15:09:25 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:08:22.587 15:09:25 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:08:22.587 15:09:25 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:08:22.587 15:09:25 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:08:22.587 15:09:25 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:08:22.587 15:09:25 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:08:22.587 15:09:25 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:08:22.587 15:09:25 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:08:22.587 15:09:25 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:22.587 15:09:25 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:08:22.587 15:09:25 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:08:22.587 15:09:25 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:08:22.587 15:09:25 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:08:22.587 15:09:25 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:08:22.587 15:09:25 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:08:22.587 15:09:25 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:08:22.587 15:09:25 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:08:22.587 15:09:25 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:08:22.587 15:09:25 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:08:22.587 15:09:25 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:22.587 15:09:25 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:22.587 15:09:25 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:22.587 15:09:25 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:22.587 15:09:25 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:22.587 15:09:25 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:22.587 15:09:25 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/config.h ]] 00:08:22.587 15:09:25 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:22.587 #define SPDK_CONFIG_H 00:08:22.587 #define SPDK_CONFIG_APPS 1 00:08:22.587 #define SPDK_CONFIG_ARCH native 00:08:22.587 #undef SPDK_CONFIG_ASAN 00:08:22.587 #undef SPDK_CONFIG_AVAHI 00:08:22.587 #undef SPDK_CONFIG_CET 00:08:22.587 #define SPDK_CONFIG_COVERAGE 1 00:08:22.587 #define SPDK_CONFIG_CROSS_PREFIX 00:08:22.587 #undef SPDK_CONFIG_CRYPTO 00:08:22.587 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:22.587 #undef SPDK_CONFIG_CUSTOMOCF 00:08:22.587 #undef SPDK_CONFIG_DAOS 00:08:22.587 #define SPDK_CONFIG_DAOS_DIR 00:08:22.587 #define SPDK_CONFIG_DEBUG 1 00:08:22.587 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:22.587 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:08:22.587 #define SPDK_CONFIG_DPDK_INC_DIR 00:08:22.587 #define SPDK_CONFIG_DPDK_LIB_DIR 00:08:22.587 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:22.587 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:08:22.587 #define SPDK_CONFIG_EXAMPLES 1 00:08:22.587 #undef SPDK_CONFIG_FC 00:08:22.587 #define SPDK_CONFIG_FC_PATH 00:08:22.587 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:22.587 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:22.587 #undef SPDK_CONFIG_FUSE 00:08:22.587 #undef SPDK_CONFIG_FUZZER 00:08:22.587 #define SPDK_CONFIG_FUZZER_LIB 00:08:22.587 #undef SPDK_CONFIG_GOLANG 00:08:22.587 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:22.587 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:08:22.587 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:22.587 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:08:22.587 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:22.587 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:22.587 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:22.587 #define SPDK_CONFIG_IDXD 1 00:08:22.587 #undef SPDK_CONFIG_IDXD_KERNEL 00:08:22.587 #undef SPDK_CONFIG_IPSEC_MB 00:08:22.587 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:22.587 #define SPDK_CONFIG_ISAL 1 00:08:22.587 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:22.587 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:22.588 #define SPDK_CONFIG_LIBDIR 00:08:22.588 #undef SPDK_CONFIG_LTO 00:08:22.588 #define SPDK_CONFIG_MAX_LCORES 00:08:22.588 #define SPDK_CONFIG_NVME_CUSE 1 00:08:22.588 #undef SPDK_CONFIG_OCF 00:08:22.588 #define SPDK_CONFIG_OCF_PATH 00:08:22.588 #define SPDK_CONFIG_OPENSSL_PATH 00:08:22.588 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:22.588 #define SPDK_CONFIG_PGO_DIR 00:08:22.588 #undef SPDK_CONFIG_PGO_USE 00:08:22.588 #define SPDK_CONFIG_PREFIX /usr/local 00:08:22.588 #undef SPDK_CONFIG_RAID5F 00:08:22.588 #undef SPDK_CONFIG_RBD 00:08:22.588 #define SPDK_CONFIG_RDMA 1 00:08:22.588 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:22.588 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:22.588 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:22.588 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:22.588 #define SPDK_CONFIG_SHARED 1 00:08:22.588 #undef SPDK_CONFIG_SMA 00:08:22.588 #define SPDK_CONFIG_TESTS 1 00:08:22.588 #undef SPDK_CONFIG_TSAN 00:08:22.588 #define SPDK_CONFIG_UBLK 1 00:08:22.588 #define SPDK_CONFIG_UBSAN 1 00:08:22.588 #undef SPDK_CONFIG_UNIT_TESTS 00:08:22.588 #undef SPDK_CONFIG_URING 00:08:22.588 #define SPDK_CONFIG_URING_PATH 00:08:22.588 #undef SPDK_CONFIG_URING_ZNS 00:08:22.588 #undef SPDK_CONFIG_USDT 00:08:22.588 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:22.588 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:22.588 #undef SPDK_CONFIG_VFIO_USER 00:08:22.588 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:22.588 #define SPDK_CONFIG_VHOST 1 00:08:22.588 #define SPDK_CONFIG_VIRTIO 1 00:08:22.588 #undef SPDK_CONFIG_VTUNE 00:08:22.588 #define SPDK_CONFIG_VTUNE_DIR 00:08:22.588 #define SPDK_CONFIG_WERROR 1 00:08:22.588 #define SPDK_CONFIG_WPDK_DIR 00:08:22.588 #undef SPDK_CONFIG_XNVME 00:08:22.588 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:22.588 15:09:25 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:22.588 15:09:25 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:22.588 15:09:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:22.588 15:09:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:22.588 15:09:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:22.588 15:09:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.588 15:09:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.588 15:09:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.588 15:09:25 -- paths/export.sh@5 -- # export PATH 00:08:22.588 15:09:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.588 15:09:25 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:08:22.588 15:09:25 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:08:22.588 15:09:25 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:08:22.588 15:09:25 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:08:22.588 15:09:26 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:22.588 15:09:26 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:08:22.588 15:09:26 -- pm/common@67 -- # TEST_TAG=N/A 00:08:22.588 15:09:26 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.run_test_name 00:08:22.588 15:09:26 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:08:22.588 15:09:26 -- pm/common@71 -- # uname -s 00:08:22.588 15:09:26 -- pm/common@71 -- # PM_OS=Linux 00:08:22.588 15:09:26 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:08:22.588 15:09:26 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:08:22.588 15:09:26 -- pm/common@76 -- # [[ Linux == Linux ]] 00:08:22.588 15:09:26 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:08:22.588 15:09:26 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:08:22.588 15:09:26 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:08:22.588 15:09:26 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:08:22.588 15:09:26 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:08:22.588 15:09:26 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:08:22.588 15:09:26 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:08:22.588 15:09:26 -- common/autotest_common.sh@57 -- # : 1 00:08:22.588 15:09:26 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:08:22.588 15:09:26 -- common/autotest_common.sh@61 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:22.588 15:09:26 -- common/autotest_common.sh@63 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:08:22.588 15:09:26 -- common/autotest_common.sh@65 -- # : 1 00:08:22.588 15:09:26 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:22.588 15:09:26 -- common/autotest_common.sh@67 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:08:22.588 15:09:26 -- common/autotest_common.sh@69 -- # : 00:08:22.588 15:09:26 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:08:22.588 15:09:26 -- common/autotest_common.sh@71 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:08:22.588 15:09:26 -- common/autotest_common.sh@73 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:08:22.588 15:09:26 -- common/autotest_common.sh@75 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:08:22.588 15:09:26 -- common/autotest_common.sh@77 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:22.588 15:09:26 -- common/autotest_common.sh@79 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:08:22.588 15:09:26 -- common/autotest_common.sh@81 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:08:22.588 15:09:26 -- common/autotest_common.sh@83 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:08:22.588 15:09:26 -- common/autotest_common.sh@85 -- # : 1 00:08:22.588 15:09:26 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:08:22.588 15:09:26 -- common/autotest_common.sh@87 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:08:22.588 15:09:26 -- common/autotest_common.sh@89 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:08:22.588 15:09:26 -- common/autotest_common.sh@91 -- # : 1 00:08:22.588 15:09:26 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:08:22.588 15:09:26 -- common/autotest_common.sh@93 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:08:22.588 15:09:26 -- common/autotest_common.sh@95 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:22.588 15:09:26 -- common/autotest_common.sh@97 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:08:22.588 15:09:26 -- common/autotest_common.sh@99 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:08:22.588 15:09:26 -- common/autotest_common.sh@101 -- # : rdma 00:08:22.588 15:09:26 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:22.588 15:09:26 -- common/autotest_common.sh@103 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:08:22.588 15:09:26 -- common/autotest_common.sh@105 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:08:22.588 15:09:26 -- common/autotest_common.sh@107 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:08:22.588 15:09:26 -- common/autotest_common.sh@109 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:08:22.588 15:09:26 -- common/autotest_common.sh@111 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:08:22.588 15:09:26 -- common/autotest_common.sh@113 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:08:22.588 15:09:26 -- common/autotest_common.sh@115 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:08:22.588 15:09:26 -- common/autotest_common.sh@117 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:22.588 15:09:26 -- common/autotest_common.sh@119 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:08:22.588 15:09:26 -- common/autotest_common.sh@121 -- # : 1 00:08:22.588 15:09:26 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:08:22.588 15:09:26 -- common/autotest_common.sh@123 -- # : 00:08:22.588 15:09:26 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:22.588 15:09:26 -- common/autotest_common.sh@125 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:08:22.588 15:09:26 -- common/autotest_common.sh@127 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:08:22.588 15:09:26 -- common/autotest_common.sh@129 -- # : 0 00:08:22.588 15:09:26 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:08:22.588 15:09:26 -- common/autotest_common.sh@131 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:08:22.589 15:09:26 -- common/autotest_common.sh@133 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:08:22.589 15:09:26 -- common/autotest_common.sh@135 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:08:22.589 15:09:26 -- common/autotest_common.sh@137 -- # : 00:08:22.589 15:09:26 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:08:22.589 15:09:26 -- common/autotest_common.sh@139 -- # : true 00:08:22.589 15:09:26 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:08:22.589 15:09:26 -- common/autotest_common.sh@141 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:08:22.589 15:09:26 -- common/autotest_common.sh@143 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:08:22.589 15:09:26 -- common/autotest_common.sh@145 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:08:22.589 15:09:26 -- common/autotest_common.sh@147 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:08:22.589 15:09:26 -- common/autotest_common.sh@149 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:08:22.589 15:09:26 -- common/autotest_common.sh@151 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:08:22.589 15:09:26 -- common/autotest_common.sh@153 -- # : e810 00:08:22.589 15:09:26 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:08:22.589 15:09:26 -- common/autotest_common.sh@155 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:08:22.589 15:09:26 -- common/autotest_common.sh@157 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:08:22.589 15:09:26 -- common/autotest_common.sh@159 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:08:22.589 15:09:26 -- common/autotest_common.sh@161 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:08:22.589 15:09:26 -- common/autotest_common.sh@163 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:08:22.589 15:09:26 -- common/autotest_common.sh@166 -- # : 00:08:22.589 15:09:26 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:08:22.589 15:09:26 -- common/autotest_common.sh@168 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:08:22.589 15:09:26 -- common/autotest_common.sh@170 -- # : 0 00:08:22.589 15:09:26 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:22.589 15:09:26 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:22.589 15:09:26 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:08:22.589 15:09:26 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:08:22.589 15:09:26 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:22.589 15:09:26 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:08:22.589 15:09:26 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:22.589 15:09:26 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:22.589 15:09:26 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:22.589 15:09:26 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:22.589 15:09:26 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:22.589 15:09:26 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:08:22.589 15:09:26 -- common/autotest_common.sh@199 -- # cat 00:08:22.589 15:09:26 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:08:22.589 15:09:26 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:22.589 15:09:26 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:22.589 15:09:26 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:22.589 15:09:26 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:22.589 15:09:26 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:08:22.589 15:09:26 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:08:22.589 15:09:26 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:08:22.589 15:09:26 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:08:22.589 15:09:26 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:08:22.589 15:09:26 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:08:22.589 15:09:26 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:22.589 15:09:26 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:22.589 15:09:26 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:22.589 15:09:26 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:22.589 15:09:26 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:22.589 15:09:26 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:22.589 15:09:26 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:08:22.589 15:09:26 -- common/autotest_common.sh@252 -- # export valgrind= 00:08:22.589 15:09:26 -- common/autotest_common.sh@252 -- # valgrind= 00:08:22.589 15:09:26 -- common/autotest_common.sh@258 -- # uname -s 00:08:22.589 15:09:26 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:08:22.589 15:09:26 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:08:22.589 15:09:26 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:08:22.589 15:09:26 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:22.589 15:09:26 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:22.589 15:09:26 -- common/autotest_common.sh@268 -- # MAKE=make 00:08:22.589 15:09:26 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:08:22.589 15:09:26 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:08:22.589 15:09:26 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:08:22.589 15:09:26 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:08:22.589 15:09:26 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:08:22.589 15:09:26 -- common/autotest_common.sh@289 -- # for i in "$@" 00:08:22.589 15:09:26 -- common/autotest_common.sh@290 -- # case "$i" in 00:08:22.589 15:09:26 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:08:22.589 15:09:26 -- common/autotest_common.sh@307 -- # [[ -z 518766 ]] 00:08:22.589 15:09:26 -- common/autotest_common.sh@307 -- # kill -0 518766 00:08:22.589 15:09:26 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:08:22.589 15:09:26 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:08:22.589 15:09:26 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:08:22.589 15:09:26 -- common/autotest_common.sh@320 -- # local mount target_dir 00:08:22.589 15:09:26 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:08:22.589 15:09:26 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:08:22.589 15:09:26 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:08:22.589 15:09:26 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:08:22.590 15:09:26 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.hpJaya 00:08:22.590 15:09:26 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:22.590 15:09:26 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target /tmp/spdk.hpJaya/tests/target /tmp/spdk.hpJaya 00:08:22.590 15:09:26 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:08:22.590 15:09:26 -- common/autotest_common.sh@316 -- # df -T 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=902680576 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=4381749248 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=89109327872 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=94519009280 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=5409681408 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=47258226688 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47259504640 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=18894397440 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=18903801856 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=9404416 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=47259193344 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47259504640 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=311296 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # avails["$mount"]=9451896832 00:08:22.590 15:09:26 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9451900928 00:08:22.590 15:09:26 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:08:22.590 15:09:26 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:22.590 15:09:26 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:08:22.590 * Looking for test storage... 00:08:22.590 15:09:26 -- common/autotest_common.sh@357 -- # local target_space new_size 00:08:22.590 15:09:26 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:08:22.590 15:09:26 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.590 15:09:26 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:22.590 15:09:26 -- common/autotest_common.sh@361 -- # mount=/ 00:08:22.590 15:09:26 -- common/autotest_common.sh@363 -- # target_space=89109327872 00:08:22.590 15:09:26 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:08:22.590 15:09:26 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:08:22.590 15:09:26 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@370 -- # new_size=7624273920 00:08:22.590 15:09:26 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:22.590 15:09:26 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.590 15:09:26 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.590 15:09:26 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.590 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:22.590 15:09:26 -- common/autotest_common.sh@378 -- # return 0 00:08:22.590 15:09:26 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:08:22.590 15:09:26 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:08:22.590 15:09:26 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:22.590 15:09:26 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:22.590 15:09:26 -- common/autotest_common.sh@1673 -- # true 00:08:22.590 15:09:26 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:08:22.590 15:09:26 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:22.590 15:09:26 -- common/autotest_common.sh@27 -- # exec 00:08:22.590 15:09:26 -- common/autotest_common.sh@29 -- # exec 00:08:22.590 15:09:26 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:22.590 15:09:26 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:22.590 15:09:26 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:22.590 15:09:26 -- common/autotest_common.sh@18 -- # set -x 00:08:22.590 15:09:26 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:08:22.590 15:09:26 -- nvmf/common.sh@7 -- # uname -s 00:08:22.590 15:09:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:22.590 15:09:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:22.590 15:09:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:22.590 15:09:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:22.590 15:09:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:22.590 15:09:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:22.590 15:09:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:22.590 15:09:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:22.590 15:09:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:22.590 15:09:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:22.590 15:09:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:08:22.590 15:09:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:08:22.590 15:09:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:22.590 15:09:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:22.590 15:09:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:22.590 15:09:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:22.590 15:09:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:22.590 15:09:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:22.590 15:09:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:22.590 15:09:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:22.590 15:09:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.590 15:09:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.590 15:09:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.590 15:09:26 -- paths/export.sh@5 -- # export PATH 00:08:22.590 15:09:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:22.590 15:09:26 -- nvmf/common.sh@47 -- # : 0 00:08:22.590 15:09:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:22.590 15:09:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:22.590 15:09:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:22.590 15:09:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:22.590 15:09:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:22.590 15:09:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:22.590 15:09:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:22.591 15:09:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:22.591 15:09:26 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:22.591 15:09:26 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:22.591 15:09:26 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:22.591 15:09:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:22.591 15:09:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:22.591 15:09:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:22.591 15:09:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:22.591 15:09:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:22.591 15:09:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:22.591 15:09:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:22.591 15:09:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:22.591 15:09:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:22.591 15:09:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:22.591 15:09:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:22.591 15:09:26 -- common/autotest_common.sh@10 -- # set +x 00:08:30.731 15:09:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:30.731 15:09:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:30.731 15:09:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:30.731 15:09:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:30.731 15:09:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:30.731 15:09:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:30.731 15:09:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:30.731 15:09:33 -- nvmf/common.sh@295 -- # net_devs=() 00:08:30.731 15:09:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:30.731 15:09:33 -- nvmf/common.sh@296 -- # e810=() 00:08:30.731 15:09:33 -- nvmf/common.sh@296 -- # local -ga e810 00:08:30.731 15:09:33 -- nvmf/common.sh@297 -- # x722=() 00:08:30.731 15:09:33 -- nvmf/common.sh@297 -- # local -ga x722 00:08:30.731 15:09:33 -- nvmf/common.sh@298 -- # mlx=() 00:08:30.731 15:09:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:30.731 15:09:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:30.731 15:09:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:30.732 15:09:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:30.732 15:09:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:30.732 15:09:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:08:30.732 Found 0000:18:00.0 (0x8086 - 0x1592) 00:08:30.732 15:09:33 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:30.732 15:09:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:08:30.732 Found 0000:18:00.1 (0x8086 - 0x1592) 00:08:30.732 15:09:33 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:30.732 15:09:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@377 -- # modinfo irdma 00:08:30.732 15:09:33 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:08:30.732 15:09:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:30.732 15:09:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:30.732 15:09:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:08:30.732 Found net devices under 0000:18:00.0: cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:30.732 15:09:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:30.732 15:09:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:08:30.732 Found net devices under 0000:18:00.1: cvl_0_1 00:08:30.732 15:09:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:30.732 15:09:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:30.732 15:09:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:30.732 15:09:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:30.732 15:09:33 -- nvmf/common.sh@58 -- # uname 00:08:30.732 15:09:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:30.732 15:09:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:30.732 15:09:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:30.732 15:09:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:30.732 15:09:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:30.732 15:09:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:30.732 15:09:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:30.732 15:09:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:30.732 15:09:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:30.732 15:09:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:30.732 15:09:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:30.732 15:09:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:30.732 15:09:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:30.732 15:09:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:30.732 15:09:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:30.732 15:09:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@105 -- # continue 2 00:08:30.732 15:09:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:30.732 15:09:33 -- nvmf/common.sh@105 -- # continue 2 00:08:30.732 15:09:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:30.732 15:09:33 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:30.732 15:09:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:30.732 15:09:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:08:30.732 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:30.732 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:08:30.732 altname enp24s0f0np0 00:08:30.732 altname ens785f0np0 00:08:30.732 inet 192.168.100.8/24 scope global cvl_0_0 00:08:30.732 valid_lft forever preferred_lft forever 00:08:30.732 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:08:30.732 valid_lft forever preferred_lft forever 00:08:30.732 15:09:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:30.732 15:09:33 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:08:30.732 15:09:33 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:30.732 15:09:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:30.732 15:09:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:30.732 15:09:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:08:30.732 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:30.732 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:08:30.732 altname enp24s0f1np1 00:08:30.732 altname ens785f1np1 00:08:30.732 inet 192.168.100.9/24 scope global cvl_0_1 00:08:30.732 valid_lft forever preferred_lft forever 00:08:30.732 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:08:30.732 valid_lft forever preferred_lft forever 00:08:30.732 15:09:33 -- nvmf/common.sh@411 -- # return 0 00:08:30.732 15:09:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:30.732 15:09:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:30.732 15:09:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:30.732 15:09:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:30.732 15:09:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:30.732 15:09:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:30.732 15:09:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:30.732 15:09:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:30.732 15:09:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:30.732 15:09:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:30.732 15:09:33 -- nvmf/common.sh@105 -- # continue 2 00:08:30.732 15:09:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:30.732 15:09:33 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:30.732 15:09:33 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:30.733 15:09:33 -- nvmf/common.sh@105 -- # continue 2 00:08:30.733 15:09:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:30.733 15:09:33 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:08:30.733 15:09:33 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:30.733 15:09:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:30.733 15:09:33 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:08:30.733 15:09:33 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:30.733 15:09:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:30.733 15:09:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:30.733 192.168.100.9' 00:08:30.733 15:09:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:30.733 192.168.100.9' 00:08:30.733 15:09:33 -- nvmf/common.sh@446 -- # head -n 1 00:08:30.733 15:09:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:30.733 15:09:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:30.733 192.168.100.9' 00:08:30.733 15:09:33 -- nvmf/common.sh@447 -- # head -n 1 00:08:30.733 15:09:33 -- nvmf/common.sh@447 -- # tail -n +2 00:08:30.733 15:09:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:30.733 15:09:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:30.733 15:09:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:30.733 15:09:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:30.733 15:09:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:30.733 15:09:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:30.733 15:09:33 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:30.733 15:09:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:30.733 15:09:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:30.733 15:09:33 -- common/autotest_common.sh@10 -- # set +x 00:08:30.733 ************************************ 00:08:30.733 START TEST nvmf_filesystem_no_in_capsule 00:08:30.733 ************************************ 00:08:30.733 15:09:33 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:08:30.733 15:09:33 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:30.733 15:09:33 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:30.733 15:09:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:30.733 15:09:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:30.733 15:09:33 -- common/autotest_common.sh@10 -- # set +x 00:08:30.733 15:09:33 -- nvmf/common.sh@470 -- # nvmfpid=522037 00:08:30.733 15:09:33 -- nvmf/common.sh@471 -- # waitforlisten 522037 00:08:30.733 15:09:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:30.733 15:09:33 -- common/autotest_common.sh@817 -- # '[' -z 522037 ']' 00:08:30.733 15:09:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:30.733 15:09:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:30.733 15:09:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:30.733 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:30.733 15:09:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:30.733 15:09:33 -- common/autotest_common.sh@10 -- # set +x 00:08:30.733 [2024-04-24 15:09:33.705310] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:08:30.733 [2024-04-24 15:09:33.705366] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:30.733 EAL: No free 2048 kB hugepages reported on node 1 00:08:30.733 [2024-04-24 15:09:33.789966] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:30.733 [2024-04-24 15:09:33.874099] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:30.733 [2024-04-24 15:09:33.874144] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:30.733 [2024-04-24 15:09:33.874154] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:30.733 [2024-04-24 15:09:33.874163] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:30.733 [2024-04-24 15:09:33.874171] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:30.733 [2024-04-24 15:09:33.874222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:30.733 [2024-04-24 15:09:33.874308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:30.733 [2024-04-24 15:09:33.874388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:30.733 [2024-04-24 15:09:33.874389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:30.733 15:09:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:30.733 15:09:34 -- common/autotest_common.sh@850 -- # return 0 00:08:30.733 15:09:34 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:30.733 15:09:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:30.733 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.733 15:09:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:30.733 15:09:34 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:30.733 15:09:34 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:30.733 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.733 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.733 [2024-04-24 15:09:34.575384] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:30.733 [2024-04-24 15:09:34.592907] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xd3c910/0xd3bf50) succeed. 00:08:30.733 [2024-04-24 15:09:34.603339] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xd3dc80/0xd3c4d0) succeed. 00:08:30.733 [2024-04-24 15:09:34.603374] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:08:30.733 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.733 15:09:34 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:30.733 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.733 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.993 Malloc1 00:08:30.993 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.993 15:09:34 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:30.993 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.993 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.993 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.993 15:09:34 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:30.993 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.993 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.993 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.993 15:09:34 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:30.993 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.993 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.993 [2024-04-24 15:09:34.771474] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:30.993 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.993 15:09:34 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:30.993 15:09:34 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:30.993 15:09:34 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:30.993 15:09:34 -- common/autotest_common.sh@1366 -- # local bs 00:08:30.993 15:09:34 -- common/autotest_common.sh@1367 -- # local nb 00:08:30.993 15:09:34 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:30.993 15:09:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:30.993 15:09:34 -- common/autotest_common.sh@10 -- # set +x 00:08:30.993 15:09:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:30.993 15:09:34 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:30.993 { 00:08:30.993 "name": "Malloc1", 00:08:30.993 "aliases": [ 00:08:30.993 "d618e777-e063-452a-886d-e5b9ec9136a7" 00:08:30.993 ], 00:08:30.993 "product_name": "Malloc disk", 00:08:30.993 "block_size": 512, 00:08:30.993 "num_blocks": 1048576, 00:08:30.993 "uuid": "d618e777-e063-452a-886d-e5b9ec9136a7", 00:08:30.993 "assigned_rate_limits": { 00:08:30.993 "rw_ios_per_sec": 0, 00:08:30.993 "rw_mbytes_per_sec": 0, 00:08:30.993 "r_mbytes_per_sec": 0, 00:08:30.993 "w_mbytes_per_sec": 0 00:08:30.993 }, 00:08:30.993 "claimed": true, 00:08:30.993 "claim_type": "exclusive_write", 00:08:30.993 "zoned": false, 00:08:30.993 "supported_io_types": { 00:08:30.993 "read": true, 00:08:30.993 "write": true, 00:08:30.993 "unmap": true, 00:08:30.993 "write_zeroes": true, 00:08:30.993 "flush": true, 00:08:30.993 "reset": true, 00:08:30.993 "compare": false, 00:08:30.993 "compare_and_write": false, 00:08:30.993 "abort": true, 00:08:30.993 "nvme_admin": false, 00:08:30.993 "nvme_io": false 00:08:30.993 }, 00:08:30.993 "memory_domains": [ 00:08:30.993 { 00:08:30.993 "dma_device_id": "system", 00:08:30.993 "dma_device_type": 1 00:08:30.993 }, 00:08:30.993 { 00:08:30.993 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:30.993 "dma_device_type": 2 00:08:30.993 } 00:08:30.993 ], 00:08:30.993 "driver_specific": {} 00:08:30.993 } 00:08:30.994 ]' 00:08:30.994 15:09:34 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:30.994 15:09:34 -- common/autotest_common.sh@1369 -- # bs=512 00:08:30.994 15:09:34 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:30.994 15:09:34 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:30.994 15:09:34 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:30.994 15:09:34 -- common/autotest_common.sh@1374 -- # echo 512 00:08:30.994 15:09:34 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:30.994 15:09:34 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:31.253 15:09:35 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:31.253 15:09:35 -- common/autotest_common.sh@1184 -- # local i=0 00:08:31.253 15:09:35 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:31.253 15:09:35 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:31.253 15:09:35 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:33.794 15:09:37 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:33.794 15:09:37 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:33.794 15:09:37 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:33.794 15:09:37 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:33.794 15:09:37 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:33.794 15:09:37 -- common/autotest_common.sh@1194 -- # return 0 00:08:33.794 15:09:37 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:33.794 15:09:37 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:33.794 15:09:37 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:33.794 15:09:37 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:33.794 15:09:37 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:33.794 15:09:37 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:33.794 15:09:37 -- setup/common.sh@80 -- # echo 536870912 00:08:33.794 15:09:37 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:33.794 15:09:37 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:33.794 15:09:37 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:33.794 15:09:37 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:33.794 15:09:37 -- target/filesystem.sh@69 -- # partprobe 00:08:33.794 15:09:37 -- target/filesystem.sh@70 -- # sleep 1 00:08:34.735 15:09:38 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:34.735 15:09:38 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:34.735 15:09:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.735 15:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.735 15:09:38 -- common/autotest_common.sh@10 -- # set +x 00:08:34.735 ************************************ 00:08:34.735 START TEST filesystem_ext4 00:08:34.735 ************************************ 00:08:34.735 15:09:38 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:34.735 15:09:38 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:34.735 15:09:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.735 15:09:38 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:34.735 15:09:38 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:34.735 15:09:38 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.735 15:09:38 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.735 15:09:38 -- common/autotest_common.sh@915 -- # local force 00:08:34.735 15:09:38 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:34.735 15:09:38 -- common/autotest_common.sh@918 -- # force=-F 00:08:34.735 15:09:38 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:34.735 mke2fs 1.46.5 (30-Dec-2021) 00:08:34.995 Discarding device blocks: 0/522240 done 00:08:34.995 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:34.995 Filesystem UUID: f45bc6bd-5649-4c29-a231-54da9f30bec8 00:08:34.995 Superblock backups stored on blocks: 00:08:34.995 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:34.995 00:08:34.995 Allocating group tables: 0/64 done 00:08:34.995 Writing inode tables: 0/64 done 00:08:34.995 Creating journal (8192 blocks): done 00:08:34.995 Writing superblocks and filesystem accounting information: 0/64 done 00:08:34.995 00:08:34.995 15:09:38 -- common/autotest_common.sh@931 -- # return 0 00:08:34.995 15:09:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:34.995 15:09:38 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:34.995 15:09:38 -- target/filesystem.sh@25 -- # sync 00:08:34.995 15:09:38 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:34.995 15:09:38 -- target/filesystem.sh@27 -- # sync 00:08:34.995 15:09:38 -- target/filesystem.sh@29 -- # i=0 00:08:34.995 15:09:38 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:34.995 15:09:38 -- target/filesystem.sh@37 -- # kill -0 522037 00:08:34.995 15:09:38 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:34.995 15:09:38 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:34.995 15:09:38 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:34.995 15:09:38 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:34.995 00:08:34.995 real 0m0.198s 00:08:34.995 user 0m0.028s 00:08:34.995 sys 0m0.073s 00:08:34.995 15:09:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:34.995 15:09:38 -- common/autotest_common.sh@10 -- # set +x 00:08:34.995 ************************************ 00:08:34.995 END TEST filesystem_ext4 00:08:34.995 ************************************ 00:08:34.995 15:09:38 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:34.995 15:09:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.995 15:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.995 15:09:38 -- common/autotest_common.sh@10 -- # set +x 00:08:35.254 ************************************ 00:08:35.254 START TEST filesystem_btrfs 00:08:35.254 ************************************ 00:08:35.254 15:09:39 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:35.254 15:09:39 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:35.254 15:09:39 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:35.254 15:09:39 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:35.254 15:09:39 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:35.254 15:09:39 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:35.254 15:09:39 -- common/autotest_common.sh@914 -- # local i=0 00:08:35.254 15:09:39 -- common/autotest_common.sh@915 -- # local force 00:08:35.254 15:09:39 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:35.254 15:09:39 -- common/autotest_common.sh@920 -- # force=-f 00:08:35.254 15:09:39 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:35.515 btrfs-progs v6.6.2 00:08:35.515 See https://btrfs.readthedocs.io for more information. 00:08:35.515 00:08:35.515 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:35.515 NOTE: several default settings have changed in version 5.15, please make sure 00:08:35.515 this does not affect your deployments: 00:08:35.515 - DUP for metadata (-m dup) 00:08:35.515 - enabled no-holes (-O no-holes) 00:08:35.515 - enabled free-space-tree (-R free-space-tree) 00:08:35.515 00:08:35.515 Label: (null) 00:08:35.515 UUID: ddbfeef4-6300-4a3a-932e-0241b01f48cc 00:08:35.515 Node size: 16384 00:08:35.515 Sector size: 4096 00:08:35.515 Filesystem size: 510.00MiB 00:08:35.515 Block group profiles: 00:08:35.515 Data: single 8.00MiB 00:08:35.515 Metadata: DUP 32.00MiB 00:08:35.515 System: DUP 8.00MiB 00:08:35.515 SSD detected: yes 00:08:35.515 Zoned device: no 00:08:35.515 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:35.515 Runtime features: free-space-tree 00:08:35.515 Checksum: crc32c 00:08:35.515 Number of devices: 1 00:08:35.515 Devices: 00:08:35.515 ID SIZE PATH 00:08:35.515 1 510.00MiB /dev/nvme0n1p1 00:08:35.515 00:08:35.515 15:09:39 -- common/autotest_common.sh@931 -- # return 0 00:08:35.515 15:09:39 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:35.515 15:09:39 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:35.515 15:09:39 -- target/filesystem.sh@25 -- # sync 00:08:35.515 15:09:39 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:35.515 15:09:39 -- target/filesystem.sh@27 -- # sync 00:08:35.515 15:09:39 -- target/filesystem.sh@29 -- # i=0 00:08:35.515 15:09:39 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:35.515 15:09:39 -- target/filesystem.sh@37 -- # kill -0 522037 00:08:35.515 15:09:39 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:35.515 15:09:39 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:35.515 15:09:39 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:35.515 15:09:39 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:35.515 00:08:35.515 real 0m0.305s 00:08:35.515 user 0m0.025s 00:08:35.515 sys 0m0.187s 00:08:35.515 15:09:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:35.515 15:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:35.515 ************************************ 00:08:35.515 END TEST filesystem_btrfs 00:08:35.515 ************************************ 00:08:35.515 15:09:39 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:35.515 15:09:39 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:35.515 15:09:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:35.515 15:09:39 -- common/autotest_common.sh@10 -- # set +x 00:08:35.775 ************************************ 00:08:35.775 START TEST filesystem_xfs 00:08:35.775 ************************************ 00:08:35.775 15:09:39 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:35.775 15:09:39 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:35.775 15:09:39 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:35.775 15:09:39 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:35.775 15:09:39 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:35.775 15:09:39 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:35.775 15:09:39 -- common/autotest_common.sh@914 -- # local i=0 00:08:35.775 15:09:39 -- common/autotest_common.sh@915 -- # local force 00:08:35.775 15:09:39 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:35.775 15:09:39 -- common/autotest_common.sh@920 -- # force=-f 00:08:35.775 15:09:39 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:35.775 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:35.775 = sectsz=512 attr=2, projid32bit=1 00:08:35.775 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:35.775 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:35.775 data = bsize=4096 blocks=130560, imaxpct=25 00:08:35.775 = sunit=0 swidth=0 blks 00:08:35.775 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:35.775 log =internal log bsize=4096 blocks=16384, version=2 00:08:35.775 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:35.775 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:36.034 Discarding blocks...Done. 00:08:36.034 15:09:39 -- common/autotest_common.sh@931 -- # return 0 00:08:36.034 15:09:39 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:36.294 15:09:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:36.294 15:09:40 -- target/filesystem.sh@25 -- # sync 00:08:36.294 15:09:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:36.294 15:09:40 -- target/filesystem.sh@27 -- # sync 00:08:36.294 15:09:40 -- target/filesystem.sh@29 -- # i=0 00:08:36.294 15:09:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:36.294 15:09:40 -- target/filesystem.sh@37 -- # kill -0 522037 00:08:36.294 15:09:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:36.294 15:09:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:36.294 15:09:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:36.294 15:09:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:36.553 00:08:36.553 real 0m0.671s 00:08:36.553 user 0m0.023s 00:08:36.553 sys 0m0.115s 00:08:36.553 15:09:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:36.553 15:09:40 -- common/autotest_common.sh@10 -- # set +x 00:08:36.553 ************************************ 00:08:36.553 END TEST filesystem_xfs 00:08:36.553 ************************************ 00:08:36.553 15:09:40 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:36.553 15:09:40 -- target/filesystem.sh@93 -- # sync 00:08:36.553 15:09:40 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:37.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.493 15:09:41 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:37.493 15:09:41 -- common/autotest_common.sh@1205 -- # local i=0 00:08:37.493 15:09:41 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:37.493 15:09:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:37.493 15:09:41 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:37.493 15:09:41 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:37.493 15:09:41 -- common/autotest_common.sh@1217 -- # return 0 00:08:37.493 15:09:41 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:37.493 15:09:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:37.493 15:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:37.493 15:09:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:37.493 15:09:41 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:37.493 15:09:41 -- target/filesystem.sh@101 -- # killprocess 522037 00:08:37.493 15:09:41 -- common/autotest_common.sh@936 -- # '[' -z 522037 ']' 00:08:37.493 15:09:41 -- common/autotest_common.sh@940 -- # kill -0 522037 00:08:37.493 15:09:41 -- common/autotest_common.sh@941 -- # uname 00:08:37.493 15:09:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:37.493 15:09:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 522037 00:08:37.493 15:09:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:37.493 15:09:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:37.493 15:09:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 522037' 00:08:37.493 killing process with pid 522037 00:08:37.493 15:09:41 -- common/autotest_common.sh@955 -- # kill 522037 00:08:37.493 15:09:41 -- common/autotest_common.sh@960 -- # wait 522037 00:08:37.493 [2024-04-24 15:09:41.277098] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:38.062 15:09:41 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:38.063 00:08:38.063 real 0m8.030s 00:08:38.063 user 0m31.334s 00:08:38.063 sys 0m1.576s 00:08:38.063 15:09:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:38.063 15:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.063 ************************************ 00:08:38.063 END TEST nvmf_filesystem_no_in_capsule 00:08:38.063 ************************************ 00:08:38.063 15:09:41 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:38.063 15:09:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:38.063 15:09:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:38.063 15:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.063 ************************************ 00:08:38.063 START TEST nvmf_filesystem_in_capsule 00:08:38.063 ************************************ 00:08:38.063 15:09:41 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:08:38.063 15:09:41 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:38.063 15:09:41 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:38.063 15:09:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:38.063 15:09:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:38.063 15:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.063 15:09:41 -- nvmf/common.sh@470 -- # nvmfpid=523347 00:08:38.063 15:09:41 -- nvmf/common.sh@471 -- # waitforlisten 523347 00:08:38.063 15:09:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.063 15:09:41 -- common/autotest_common.sh@817 -- # '[' -z 523347 ']' 00:08:38.063 15:09:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.063 15:09:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:38.063 15:09:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.063 15:09:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:38.063 15:09:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.063 [2024-04-24 15:09:41.928961] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:08:38.063 [2024-04-24 15:09:41.929017] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.063 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.323 [2024-04-24 15:09:42.012603] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.323 [2024-04-24 15:09:42.098577] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.323 [2024-04-24 15:09:42.098628] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.323 [2024-04-24 15:09:42.098638] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:38.323 [2024-04-24 15:09:42.098646] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:38.323 [2024-04-24 15:09:42.098670] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.323 [2024-04-24 15:09:42.098715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.323 [2024-04-24 15:09:42.098798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.323 [2024-04-24 15:09:42.098878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.323 [2024-04-24 15:09:42.098880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.891 15:09:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:38.891 15:09:42 -- common/autotest_common.sh@850 -- # return 0 00:08:38.891 15:09:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:38.891 15:09:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:38.891 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:38.891 15:09:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:38.891 15:09:42 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:38.891 15:09:42 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:08:38.891 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:38.891 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 [2024-04-24 15:09:42.809631] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1017910/0x1016f50) succeed. 00:08:39.150 [2024-04-24 15:09:42.820049] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1018c80/0x10174d0) succeed. 00:08:39.150 [2024-04-24 15:09:42.820086] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:08:39.150 15:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:42 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:39.150 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:42 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:39.150 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:39.150 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 15:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:42 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:39.150 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 15:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:42 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:39.150 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:39.150 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 [2024-04-24 15:09:42.972110] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:39.150 15:09:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:42 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:39.150 15:09:42 -- common/autotest_common.sh@1366 -- # local bs 00:08:39.150 15:09:42 -- common/autotest_common.sh@1367 -- # local nb 00:08:39.150 15:09:42 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:39.150 15:09:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:39.150 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.150 15:09:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:39.150 15:09:43 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:39.150 { 00:08:39.150 "name": "Malloc1", 00:08:39.150 "aliases": [ 00:08:39.150 "225cb4fd-231f-42db-a345-86207252a91c" 00:08:39.150 ], 00:08:39.150 "product_name": "Malloc disk", 00:08:39.150 "block_size": 512, 00:08:39.150 "num_blocks": 1048576, 00:08:39.150 "uuid": "225cb4fd-231f-42db-a345-86207252a91c", 00:08:39.150 "assigned_rate_limits": { 00:08:39.150 "rw_ios_per_sec": 0, 00:08:39.150 "rw_mbytes_per_sec": 0, 00:08:39.150 "r_mbytes_per_sec": 0, 00:08:39.150 "w_mbytes_per_sec": 0 00:08:39.150 }, 00:08:39.150 "claimed": true, 00:08:39.150 "claim_type": "exclusive_write", 00:08:39.150 "zoned": false, 00:08:39.150 "supported_io_types": { 00:08:39.150 "read": true, 00:08:39.150 "write": true, 00:08:39.150 "unmap": true, 00:08:39.150 "write_zeroes": true, 00:08:39.150 "flush": true, 00:08:39.150 "reset": true, 00:08:39.150 "compare": false, 00:08:39.150 "compare_and_write": false, 00:08:39.150 "abort": true, 00:08:39.150 "nvme_admin": false, 00:08:39.150 "nvme_io": false 00:08:39.150 }, 00:08:39.150 "memory_domains": [ 00:08:39.150 { 00:08:39.150 "dma_device_id": "system", 00:08:39.150 "dma_device_type": 1 00:08:39.150 }, 00:08:39.150 { 00:08:39.150 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:39.150 "dma_device_type": 2 00:08:39.150 } 00:08:39.150 ], 00:08:39.150 "driver_specific": {} 00:08:39.150 } 00:08:39.150 ]' 00:08:39.150 15:09:43 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:39.150 15:09:43 -- common/autotest_common.sh@1369 -- # bs=512 00:08:39.150 15:09:43 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:39.410 15:09:43 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:39.410 15:09:43 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:39.410 15:09:43 -- common/autotest_common.sh@1374 -- # echo 512 00:08:39.410 15:09:43 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:39.410 15:09:43 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:39.410 15:09:43 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:39.410 15:09:43 -- common/autotest_common.sh@1184 -- # local i=0 00:08:39.410 15:09:43 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:39.410 15:09:43 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:39.410 15:09:43 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:41.424 15:09:45 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:41.424 15:09:45 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:41.424 15:09:45 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:41.424 15:09:45 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:41.424 15:09:45 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:41.424 15:09:45 -- common/autotest_common.sh@1194 -- # return 0 00:08:41.424 15:09:45 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:41.424 15:09:45 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:41.424 15:09:45 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:41.424 15:09:45 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:41.424 15:09:45 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:41.424 15:09:45 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:41.424 15:09:45 -- setup/common.sh@80 -- # echo 536870912 00:08:41.728 15:09:45 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:41.728 15:09:45 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:41.728 15:09:45 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:41.728 15:09:45 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:41.728 15:09:45 -- target/filesystem.sh@69 -- # partprobe 00:08:42.030 15:09:45 -- target/filesystem.sh@70 -- # sleep 1 00:08:42.968 15:09:46 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:42.968 15:09:46 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:42.968 15:09:46 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:42.968 15:09:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.968 15:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:42.968 ************************************ 00:08:42.968 START TEST filesystem_in_capsule_ext4 00:08:42.968 ************************************ 00:08:42.968 15:09:46 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:42.968 15:09:46 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:42.968 15:09:46 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:42.968 15:09:46 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:42.968 15:09:46 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:42.968 15:09:46 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:42.968 15:09:46 -- common/autotest_common.sh@914 -- # local i=0 00:08:42.968 15:09:46 -- common/autotest_common.sh@915 -- # local force 00:08:42.968 15:09:46 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:42.968 15:09:46 -- common/autotest_common.sh@918 -- # force=-F 00:08:42.968 15:09:46 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:42.968 mke2fs 1.46.5 (30-Dec-2021) 00:08:43.228 Discarding device blocks: 0/522240 done 00:08:43.228 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:43.228 Filesystem UUID: 4ec4f26f-ad1a-4cf5-bf42-2f3df4135cb9 00:08:43.228 Superblock backups stored on blocks: 00:08:43.228 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:43.228 00:08:43.228 Allocating group tables: 0/64 done 00:08:43.228 Writing inode tables: 0/64 done 00:08:43.228 Creating journal (8192 blocks): done 00:08:43.228 Writing superblocks and filesystem accounting information: 0/64 done 00:08:43.228 00:08:43.228 15:09:46 -- common/autotest_common.sh@931 -- # return 0 00:08:43.228 15:09:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:43.228 15:09:46 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:43.228 15:09:46 -- target/filesystem.sh@25 -- # sync 00:08:43.228 15:09:46 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:43.228 15:09:46 -- target/filesystem.sh@27 -- # sync 00:08:43.228 15:09:46 -- target/filesystem.sh@29 -- # i=0 00:08:43.228 15:09:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:43.228 15:09:46 -- target/filesystem.sh@37 -- # kill -0 523347 00:08:43.228 15:09:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:43.228 15:09:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:43.228 15:09:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:43.228 15:09:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:43.228 00:08:43.228 real 0m0.178s 00:08:43.228 user 0m0.022s 00:08:43.228 sys 0m0.068s 00:08:43.228 15:09:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:43.228 15:09:46 -- common/autotest_common.sh@10 -- # set +x 00:08:43.228 ************************************ 00:08:43.228 END TEST filesystem_in_capsule_ext4 00:08:43.228 ************************************ 00:08:43.228 15:09:47 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:43.228 15:09:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:43.228 15:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:43.228 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:43.487 ************************************ 00:08:43.487 START TEST filesystem_in_capsule_btrfs 00:08:43.487 ************************************ 00:08:43.487 15:09:47 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:43.487 15:09:47 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:43.487 15:09:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:43.487 15:09:47 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:43.487 15:09:47 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:43.487 15:09:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:43.487 15:09:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:43.487 15:09:47 -- common/autotest_common.sh@915 -- # local force 00:08:43.487 15:09:47 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:43.487 15:09:47 -- common/autotest_common.sh@920 -- # force=-f 00:08:43.487 15:09:47 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:43.487 btrfs-progs v6.6.2 00:08:43.487 See https://btrfs.readthedocs.io for more information. 00:08:43.487 00:08:43.487 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:43.487 NOTE: several default settings have changed in version 5.15, please make sure 00:08:43.487 this does not affect your deployments: 00:08:43.487 - DUP for metadata (-m dup) 00:08:43.487 - enabled no-holes (-O no-holes) 00:08:43.487 - enabled free-space-tree (-R free-space-tree) 00:08:43.487 00:08:43.487 Label: (null) 00:08:43.487 UUID: 7ed19b7f-3754-40cf-b059-c1f710520e46 00:08:43.487 Node size: 16384 00:08:43.487 Sector size: 4096 00:08:43.487 Filesystem size: 510.00MiB 00:08:43.487 Block group profiles: 00:08:43.487 Data: single 8.00MiB 00:08:43.487 Metadata: DUP 32.00MiB 00:08:43.487 System: DUP 8.00MiB 00:08:43.487 SSD detected: yes 00:08:43.487 Zoned device: no 00:08:43.487 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:43.487 Runtime features: free-space-tree 00:08:43.487 Checksum: crc32c 00:08:43.487 Number of devices: 1 00:08:43.487 Devices: 00:08:43.487 ID SIZE PATH 00:08:43.487 1 510.00MiB /dev/nvme0n1p1 00:08:43.487 00:08:43.487 15:09:47 -- common/autotest_common.sh@931 -- # return 0 00:08:43.487 15:09:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:43.747 15:09:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:43.747 15:09:47 -- target/filesystem.sh@25 -- # sync 00:08:43.747 15:09:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:43.747 15:09:47 -- target/filesystem.sh@27 -- # sync 00:08:43.747 15:09:47 -- target/filesystem.sh@29 -- # i=0 00:08:43.747 15:09:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:43.747 15:09:47 -- target/filesystem.sh@37 -- # kill -0 523347 00:08:43.747 15:09:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:43.747 15:09:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:43.747 15:09:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:43.747 15:09:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:43.747 00:08:43.747 real 0m0.274s 00:08:43.747 user 0m0.033s 00:08:43.747 sys 0m0.134s 00:08:43.747 15:09:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:43.747 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:43.747 ************************************ 00:08:43.747 END TEST filesystem_in_capsule_btrfs 00:08:43.747 ************************************ 00:08:43.747 15:09:47 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:43.747 15:09:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:43.747 15:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:43.747 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:44.007 ************************************ 00:08:44.007 START TEST filesystem_in_capsule_xfs 00:08:44.007 ************************************ 00:08:44.007 15:09:47 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:44.007 15:09:47 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:44.007 15:09:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.008 15:09:47 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:44.008 15:09:47 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:44.008 15:09:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.008 15:09:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.008 15:09:47 -- common/autotest_common.sh@915 -- # local force 00:08:44.008 15:09:47 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:44.008 15:09:47 -- common/autotest_common.sh@920 -- # force=-f 00:08:44.008 15:09:47 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:44.008 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:44.008 = sectsz=512 attr=2, projid32bit=1 00:08:44.008 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:44.008 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:44.008 data = bsize=4096 blocks=130560, imaxpct=25 00:08:44.008 = sunit=0 swidth=0 blks 00:08:44.008 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:44.008 log =internal log bsize=4096 blocks=16384, version=2 00:08:44.008 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:44.008 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:44.008 Discarding blocks...Done. 00:08:44.008 15:09:47 -- common/autotest_common.sh@931 -- # return 0 00:08:44.008 15:09:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.008 15:09:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.008 15:09:47 -- target/filesystem.sh@25 -- # sync 00:08:44.008 15:09:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.008 15:09:47 -- target/filesystem.sh@27 -- # sync 00:08:44.008 15:09:47 -- target/filesystem.sh@29 -- # i=0 00:08:44.008 15:09:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.008 15:09:47 -- target/filesystem.sh@37 -- # kill -0 523347 00:08:44.008 15:09:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.008 15:09:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.008 15:09:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.008 15:09:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.008 00:08:44.008 real 0m0.215s 00:08:44.008 user 0m0.024s 00:08:44.008 sys 0m0.080s 00:08:44.008 15:09:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:44.008 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:08:44.008 ************************************ 00:08:44.008 END TEST filesystem_in_capsule_xfs 00:08:44.008 ************************************ 00:08:44.268 15:09:47 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:44.268 15:09:47 -- target/filesystem.sh@93 -- # sync 00:08:44.268 15:09:47 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:45.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.206 15:09:48 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:45.206 15:09:48 -- common/autotest_common.sh@1205 -- # local i=0 00:08:45.206 15:09:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:45.206 15:09:48 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:45.206 15:09:48 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:45.206 15:09:48 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:45.206 15:09:48 -- common/autotest_common.sh@1217 -- # return 0 00:08:45.206 15:09:48 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:45.206 15:09:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:45.206 15:09:48 -- common/autotest_common.sh@10 -- # set +x 00:08:45.206 15:09:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:45.206 15:09:48 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:45.206 15:09:48 -- target/filesystem.sh@101 -- # killprocess 523347 00:08:45.206 15:09:48 -- common/autotest_common.sh@936 -- # '[' -z 523347 ']' 00:08:45.206 15:09:48 -- common/autotest_common.sh@940 -- # kill -0 523347 00:08:45.206 15:09:48 -- common/autotest_common.sh@941 -- # uname 00:08:45.206 15:09:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:45.206 15:09:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 523347 00:08:45.206 15:09:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:45.206 15:09:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:45.206 15:09:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 523347' 00:08:45.206 killing process with pid 523347 00:08:45.206 15:09:48 -- common/autotest_common.sh@955 -- # kill 523347 00:08:45.206 15:09:48 -- common/autotest_common.sh@960 -- # wait 523347 00:08:45.206 [2024-04-24 15:09:48.965347] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:45.466 15:09:49 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:45.466 00:08:45.466 real 0m7.491s 00:08:45.466 user 0m29.220s 00:08:45.466 sys 0m1.471s 00:08:45.466 15:09:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:45.466 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.466 ************************************ 00:08:45.466 END TEST nvmf_filesystem_in_capsule 00:08:45.466 ************************************ 00:08:45.726 15:09:49 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:45.726 15:09:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:45.726 15:09:49 -- nvmf/common.sh@117 -- # sync 00:08:45.726 15:09:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:45.726 15:09:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:45.726 15:09:49 -- nvmf/common.sh@120 -- # set +e 00:08:45.726 15:09:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:45.726 15:09:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:45.726 rmmod nvme_rdma 00:08:45.726 rmmod nvme_fabrics 00:08:45.726 15:09:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:45.726 15:09:49 -- nvmf/common.sh@124 -- # set -e 00:08:45.726 15:09:49 -- nvmf/common.sh@125 -- # return 0 00:08:45.726 15:09:49 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:08:45.726 15:09:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:45.726 15:09:49 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:45.726 00:08:45.726 real 0m23.600s 00:08:45.726 user 1m2.936s 00:08:45.726 sys 0m8.944s 00:08:45.726 15:09:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:45.726 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.726 ************************************ 00:08:45.726 END TEST nvmf_filesystem 00:08:45.726 ************************************ 00:08:45.726 15:09:49 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:45.726 15:09:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:45.726 15:09:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.726 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.726 ************************************ 00:08:45.726 START TEST nvmf_discovery 00:08:45.726 ************************************ 00:08:45.727 15:09:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:45.986 * Looking for test storage... 00:08:45.986 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:45.986 15:09:49 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:08:45.986 15:09:49 -- nvmf/common.sh@7 -- # uname -s 00:08:45.986 15:09:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:45.986 15:09:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:45.986 15:09:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:45.986 15:09:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:45.986 15:09:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:45.986 15:09:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:45.986 15:09:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:45.986 15:09:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:45.986 15:09:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:45.986 15:09:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:45.986 15:09:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:08:45.986 15:09:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:08:45.986 15:09:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:45.986 15:09:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:45.986 15:09:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:45.986 15:09:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:45.986 15:09:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:45.986 15:09:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:45.986 15:09:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:45.986 15:09:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:45.987 15:09:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:45.987 15:09:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:45.987 15:09:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:45.987 15:09:49 -- paths/export.sh@5 -- # export PATH 00:08:45.987 15:09:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:45.987 15:09:49 -- nvmf/common.sh@47 -- # : 0 00:08:45.987 15:09:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:45.987 15:09:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:45.987 15:09:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:45.987 15:09:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:45.987 15:09:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:45.987 15:09:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:45.987 15:09:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:45.987 15:09:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:45.987 15:09:49 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:45.987 15:09:49 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:45.987 15:09:49 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:45.987 15:09:49 -- target/discovery.sh@15 -- # hash nvme 00:08:45.987 15:09:49 -- target/discovery.sh@20 -- # nvmftestinit 00:08:45.987 15:09:49 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:45.987 15:09:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:45.987 15:09:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:45.987 15:09:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:45.987 15:09:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:45.987 15:09:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:45.987 15:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:45.987 15:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:45.987 15:09:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:45.987 15:09:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:45.987 15:09:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:45.987 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:08:52.561 15:09:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:52.561 15:09:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:52.561 15:09:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:52.561 15:09:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:52.561 15:09:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:52.561 15:09:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:52.561 15:09:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:52.561 15:09:55 -- nvmf/common.sh@295 -- # net_devs=() 00:08:52.561 15:09:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:52.561 15:09:55 -- nvmf/common.sh@296 -- # e810=() 00:08:52.561 15:09:55 -- nvmf/common.sh@296 -- # local -ga e810 00:08:52.561 15:09:55 -- nvmf/common.sh@297 -- # x722=() 00:08:52.561 15:09:55 -- nvmf/common.sh@297 -- # local -ga x722 00:08:52.561 15:09:55 -- nvmf/common.sh@298 -- # mlx=() 00:08:52.561 15:09:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:52.561 15:09:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:52.561 15:09:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:52.561 15:09:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:08:52.561 Found 0000:18:00.0 (0x8086 - 0x1592) 00:08:52.561 15:09:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:52.561 15:09:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:52.561 15:09:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:08:52.561 Found 0000:18:00.1 (0x8086 - 0x1592) 00:08:52.561 15:09:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:52.561 15:09:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@377 -- # modinfo irdma 00:08:52.561 15:09:55 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:08:52.561 15:09:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:52.561 15:09:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.561 15:09:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.561 15:09:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:08:52.561 Found net devices under 0000:18:00.0: cvl_0_0 00:08:52.561 15:09:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:52.561 15:09:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.561 15:09:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.561 15:09:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:08:52.561 Found net devices under 0000:18:00.1: cvl_0_1 00:08:52.561 15:09:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.561 15:09:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:52.561 15:09:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:52.561 15:09:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:52.561 15:09:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:52.561 15:09:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:52.561 15:09:55 -- nvmf/common.sh@58 -- # uname 00:08:52.561 15:09:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:52.561 15:09:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:52.561 15:09:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:52.561 15:09:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:52.561 15:09:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:52.562 15:09:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:52.562 15:09:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:52.562 15:09:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:52.562 15:09:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:52.562 15:09:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:52.562 15:09:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:52.562 15:09:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:52.562 15:09:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:52.562 15:09:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:52.562 15:09:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:52.562 15:09:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:52.562 15:09:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@105 -- # continue 2 00:08:52.562 15:09:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@105 -- # continue 2 00:08:52.562 15:09:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:52.562 15:09:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.562 15:09:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:52.562 15:09:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:08:52.562 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:52.562 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:08:52.562 altname enp24s0f0np0 00:08:52.562 altname ens785f0np0 00:08:52.562 inet 192.168.100.8/24 scope global cvl_0_0 00:08:52.562 valid_lft forever preferred_lft forever 00:08:52.562 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:08:52.562 valid_lft forever preferred_lft forever 00:08:52.562 15:09:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:52.562 15:09:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.562 15:09:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:52.562 15:09:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:08:52.562 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:08:52.562 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:08:52.562 altname enp24s0f1np1 00:08:52.562 altname ens785f1np1 00:08:52.562 inet 192.168.100.9/24 scope global cvl_0_1 00:08:52.562 valid_lft forever preferred_lft forever 00:08:52.562 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:08:52.562 valid_lft forever preferred_lft forever 00:08:52.562 15:09:55 -- nvmf/common.sh@411 -- # return 0 00:08:52.562 15:09:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:52.562 15:09:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:52.562 15:09:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:52.562 15:09:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:52.562 15:09:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:52.562 15:09:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:52.562 15:09:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:52.562 15:09:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:52.562 15:09:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:52.562 15:09:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@105 -- # continue 2 00:08:52.562 15:09:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:52.562 15:09:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:08:52.562 15:09:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@105 -- # continue 2 00:08:52.562 15:09:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:52.562 15:09:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.562 15:09:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:52.562 15:09:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:52.562 15:09:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:52.562 15:09:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:52.562 192.168.100.9' 00:08:52.562 15:09:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:52.562 192.168.100.9' 00:08:52.562 15:09:55 -- nvmf/common.sh@446 -- # head -n 1 00:08:52.562 15:09:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:52.562 15:09:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:52.562 192.168.100.9' 00:08:52.562 15:09:55 -- nvmf/common.sh@447 -- # tail -n +2 00:08:52.562 15:09:55 -- nvmf/common.sh@447 -- # head -n 1 00:08:52.562 15:09:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:52.562 15:09:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:52.562 15:09:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:52.562 15:09:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:52.562 15:09:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:52.562 15:09:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:52.562 15:09:55 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:52.562 15:09:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:52.562 15:09:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:52.562 15:09:55 -- common/autotest_common.sh@10 -- # set +x 00:08:52.562 15:09:55 -- nvmf/common.sh@470 -- # nvmfpid=527820 00:08:52.562 15:09:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:52.562 15:09:55 -- nvmf/common.sh@471 -- # waitforlisten 527820 00:08:52.562 15:09:55 -- common/autotest_common.sh@817 -- # '[' -z 527820 ']' 00:08:52.562 15:09:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:52.562 15:09:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:52.562 15:09:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:52.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:52.562 15:09:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:52.562 15:09:55 -- common/autotest_common.sh@10 -- # set +x 00:08:52.562 [2024-04-24 15:09:56.043582] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:08:52.562 [2024-04-24 15:09:56.043629] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:52.562 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.562 [2024-04-24 15:09:56.122133] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.562 [2024-04-24 15:09:56.203441] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.562 [2024-04-24 15:09:56.203492] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.562 [2024-04-24 15:09:56.203503] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:52.562 [2024-04-24 15:09:56.203512] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:52.562 [2024-04-24 15:09:56.203519] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.562 [2024-04-24 15:09:56.203593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.562 [2024-04-24 15:09:56.203678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.562 [2024-04-24 15:09:56.203754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.562 [2024-04-24 15:09:56.203755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.131 15:09:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:53.131 15:09:56 -- common/autotest_common.sh@850 -- # return 0 00:08:53.131 15:09:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:53.131 15:09:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.131 15:09:56 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:53.131 15:09:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 [2024-04-24 15:09:56.920667] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1435910/0x1434f50) succeed. 00:08:53.131 [2024-04-24 15:09:56.931009] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1436c80/0x14354d0) succeed. 00:08:53.131 [2024-04-24 15:09:56.931036] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:08:53.131 15:09:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:56 -- target/discovery.sh@26 -- # seq 1 4 00:08:53.131 15:09:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:53.131 15:09:56 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:53.131 15:09:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 Null1 00:08:53.131 15:09:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:56 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:53.131 15:09:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:56 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:53.131 15:09:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:56 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:53.131 15:09:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:56 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 [2024-04-24 15:09:56.995474] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:53.131 15:09:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:53.131 15:09:57 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 Null2 00:08:53.131 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:57 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:57 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:57 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:57 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:53.131 15:09:57 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.131 Null3 00:08:53.131 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.131 15:09:57 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:53.131 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.131 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:53.391 15:09:57 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 Null4 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.391 15:09:57 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 4420 00:08:53.391 00:08:53.391 Discovery Log Number of Records 6, Generation counter 6 00:08:53.391 =====Discovery Log Entry 0====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: current discovery subsystem 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4420 00:08:53.391 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: explicit discovery connections, duplicate discovery information 00:08:53.391 rdma_prtype: not specified 00:08:53.391 rdma_qptype: connected 00:08:53.391 rdma_cms: rdma-cm 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 =====Discovery Log Entry 1====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: nvme subsystem 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4420 00:08:53.391 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: none 00:08:53.391 rdma_prtype: not specified 00:08:53.391 rdma_qptype: connected 00:08:53.391 rdma_cms: rdma-cm 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 =====Discovery Log Entry 2====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: nvme subsystem 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4420 00:08:53.391 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: none 00:08:53.391 rdma_prtype: not specified 00:08:53.391 rdma_qptype: connected 00:08:53.391 rdma_cms: rdma-cm 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 =====Discovery Log Entry 3====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: nvme subsystem 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4420 00:08:53.391 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: none 00:08:53.391 rdma_prtype: not specified 00:08:53.391 rdma_qptype: connected 00:08:53.391 rdma_cms: rdma-cm 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 =====Discovery Log Entry 4====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: nvme subsystem 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4420 00:08:53.391 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: none 00:08:53.391 rdma_prtype: not specified 00:08:53.391 rdma_qptype: connected 00:08:53.391 rdma_cms: rdma-cm 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 =====Discovery Log Entry 5====== 00:08:53.391 trtype: rdma 00:08:53.391 adrfam: ipv4 00:08:53.391 subtype: discovery subsystem referral 00:08:53.391 treq: not required 00:08:53.391 portid: 0 00:08:53.391 trsvcid: 4430 00:08:53.391 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:53.391 traddr: 192.168.100.8 00:08:53.391 eflags: none 00:08:53.391 rdma_prtype: unrecognized 00:08:53.391 rdma_qptype: unrecognized 00:08:53.391 rdma_cms: unrecognized 00:08:53.391 rdma_pkey: 0x0000 00:08:53.391 15:09:57 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:53.391 Perform nvmf subsystem discovery via RPC 00:08:53.391 15:09:57 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:53.391 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.391 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.391 [2024-04-24 15:09:57.220214] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:53.391 [ 00:08:53.391 { 00:08:53.391 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:53.391 "subtype": "Discovery", 00:08:53.391 "listen_addresses": [ 00:08:53.391 { 00:08:53.391 "transport": "RDMA", 00:08:53.391 "trtype": "RDMA", 00:08:53.391 "adrfam": "IPv4", 00:08:53.391 "traddr": "192.168.100.8", 00:08:53.391 "trsvcid": "4420" 00:08:53.391 } 00:08:53.391 ], 00:08:53.391 "allow_any_host": true, 00:08:53.391 "hosts": [] 00:08:53.391 }, 00:08:53.391 { 00:08:53.391 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:53.391 "subtype": "NVMe", 00:08:53.391 "listen_addresses": [ 00:08:53.391 { 00:08:53.391 "transport": "RDMA", 00:08:53.391 "trtype": "RDMA", 00:08:53.391 "adrfam": "IPv4", 00:08:53.391 "traddr": "192.168.100.8", 00:08:53.391 "trsvcid": "4420" 00:08:53.391 } 00:08:53.391 ], 00:08:53.391 "allow_any_host": true, 00:08:53.391 "hosts": [], 00:08:53.391 "serial_number": "SPDK00000000000001", 00:08:53.391 "model_number": "SPDK bdev Controller", 00:08:53.391 "max_namespaces": 32, 00:08:53.391 "min_cntlid": 1, 00:08:53.391 "max_cntlid": 65519, 00:08:53.391 "namespaces": [ 00:08:53.391 { 00:08:53.391 "nsid": 1, 00:08:53.391 "bdev_name": "Null1", 00:08:53.391 "name": "Null1", 00:08:53.391 "nguid": "E05FB33F379B4BB2A9220CFCC4BB5399", 00:08:53.391 "uuid": "e05fb33f-379b-4bb2-a922-0cfcc4bb5399" 00:08:53.391 } 00:08:53.391 ] 00:08:53.391 }, 00:08:53.391 { 00:08:53.391 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:53.391 "subtype": "NVMe", 00:08:53.391 "listen_addresses": [ 00:08:53.391 { 00:08:53.391 "transport": "RDMA", 00:08:53.391 "trtype": "RDMA", 00:08:53.391 "adrfam": "IPv4", 00:08:53.391 "traddr": "192.168.100.8", 00:08:53.391 "trsvcid": "4420" 00:08:53.391 } 00:08:53.391 ], 00:08:53.391 "allow_any_host": true, 00:08:53.391 "hosts": [], 00:08:53.392 "serial_number": "SPDK00000000000002", 00:08:53.392 "model_number": "SPDK bdev Controller", 00:08:53.392 "max_namespaces": 32, 00:08:53.392 "min_cntlid": 1, 00:08:53.392 "max_cntlid": 65519, 00:08:53.392 "namespaces": [ 00:08:53.392 { 00:08:53.392 "nsid": 1, 00:08:53.392 "bdev_name": "Null2", 00:08:53.392 "name": "Null2", 00:08:53.392 "nguid": "01A1F5B80A8E4D1E801EC5262E488324", 00:08:53.392 "uuid": "01a1f5b8-0a8e-4d1e-801e-c5262e488324" 00:08:53.392 } 00:08:53.392 ] 00:08:53.392 }, 00:08:53.392 { 00:08:53.392 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:53.392 "subtype": "NVMe", 00:08:53.392 "listen_addresses": [ 00:08:53.392 { 00:08:53.392 "transport": "RDMA", 00:08:53.392 "trtype": "RDMA", 00:08:53.392 "adrfam": "IPv4", 00:08:53.392 "traddr": "192.168.100.8", 00:08:53.392 "trsvcid": "4420" 00:08:53.392 } 00:08:53.392 ], 00:08:53.392 "allow_any_host": true, 00:08:53.392 "hosts": [], 00:08:53.392 "serial_number": "SPDK00000000000003", 00:08:53.392 "model_number": "SPDK bdev Controller", 00:08:53.392 "max_namespaces": 32, 00:08:53.392 "min_cntlid": 1, 00:08:53.392 "max_cntlid": 65519, 00:08:53.392 "namespaces": [ 00:08:53.392 { 00:08:53.392 "nsid": 1, 00:08:53.392 "bdev_name": "Null3", 00:08:53.392 "name": "Null3", 00:08:53.392 "nguid": "2ADA96BEA4CB424C9ACAA1A946D08CDC", 00:08:53.392 "uuid": "2ada96be-a4cb-424c-9aca-a1a946d08cdc" 00:08:53.392 } 00:08:53.392 ] 00:08:53.392 }, 00:08:53.392 { 00:08:53.392 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:53.392 "subtype": "NVMe", 00:08:53.392 "listen_addresses": [ 00:08:53.392 { 00:08:53.392 "transport": "RDMA", 00:08:53.392 "trtype": "RDMA", 00:08:53.392 "adrfam": "IPv4", 00:08:53.392 "traddr": "192.168.100.8", 00:08:53.392 "trsvcid": "4420" 00:08:53.392 } 00:08:53.392 ], 00:08:53.392 "allow_any_host": true, 00:08:53.392 "hosts": [], 00:08:53.392 "serial_number": "SPDK00000000000004", 00:08:53.392 "model_number": "SPDK bdev Controller", 00:08:53.392 "max_namespaces": 32, 00:08:53.392 "min_cntlid": 1, 00:08:53.392 "max_cntlid": 65519, 00:08:53.392 "namespaces": [ 00:08:53.392 { 00:08:53.392 "nsid": 1, 00:08:53.392 "bdev_name": "Null4", 00:08:53.392 "name": "Null4", 00:08:53.392 "nguid": "DC19586299204273A860C863B9DB1485", 00:08:53.392 "uuid": "dc195862-9920-4273-a860-c863b9db1485" 00:08:53.392 } 00:08:53.392 ] 00:08:53.392 } 00:08:53.392 ] 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@42 -- # seq 1 4 00:08:53.392 15:09:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:53.392 15:09:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:53.392 15:09:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:53.392 15:09:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.392 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.392 15:09:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:53.392 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.392 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.653 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.653 15:09:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:53.653 15:09:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:53.653 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.653 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.653 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.653 15:09:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:53.653 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.653 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.653 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.653 15:09:57 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:08:53.653 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.653 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.653 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.653 15:09:57 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:53.653 15:09:57 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:53.653 15:09:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:53.653 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.653 15:09:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:53.653 15:09:57 -- target/discovery.sh@49 -- # check_bdevs= 00:08:53.653 15:09:57 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:53.653 15:09:57 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:53.653 15:09:57 -- target/discovery.sh@57 -- # nvmftestfini 00:08:53.653 15:09:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:53.653 15:09:57 -- nvmf/common.sh@117 -- # sync 00:08:53.653 15:09:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:53.653 15:09:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:53.653 15:09:57 -- nvmf/common.sh@120 -- # set +e 00:08:53.653 15:09:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:53.653 15:09:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:53.653 rmmod nvme_rdma 00:08:53.653 rmmod nvme_fabrics 00:08:53.653 15:09:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:53.653 15:09:57 -- nvmf/common.sh@124 -- # set -e 00:08:53.653 15:09:57 -- nvmf/common.sh@125 -- # return 0 00:08:53.653 15:09:57 -- nvmf/common.sh@478 -- # '[' -n 527820 ']' 00:08:53.653 15:09:57 -- nvmf/common.sh@479 -- # killprocess 527820 00:08:53.653 15:09:57 -- common/autotest_common.sh@936 -- # '[' -z 527820 ']' 00:08:53.653 15:09:57 -- common/autotest_common.sh@940 -- # kill -0 527820 00:08:53.653 15:09:57 -- common/autotest_common.sh@941 -- # uname 00:08:53.653 15:09:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:53.654 15:09:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 527820 00:08:53.654 15:09:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:53.654 15:09:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:53.654 15:09:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 527820' 00:08:53.654 killing process with pid 527820 00:08:53.654 15:09:57 -- common/autotest_common.sh@955 -- # kill 527820 00:08:53.654 [2024-04-24 15:09:57.473409] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:53.654 15:09:57 -- common/autotest_common.sh@960 -- # wait 527820 00:08:53.654 [2024-04-24 15:09:57.507079] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:53.913 15:09:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:53.913 15:09:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:53.913 00:08:53.913 real 0m8.102s 00:08:53.913 user 0m7.809s 00:08:53.913 sys 0m5.245s 00:08:53.913 15:09:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:53.913 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:53.913 ************************************ 00:08:53.913 END TEST nvmf_discovery 00:08:53.913 ************************************ 00:08:53.913 15:09:57 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:53.913 15:09:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:53.913 15:09:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:53.913 15:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:54.174 ************************************ 00:08:54.174 START TEST nvmf_referrals 00:08:54.174 ************************************ 00:08:54.174 15:09:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:54.174 * Looking for test storage... 00:08:54.174 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:08:54.174 15:09:58 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:08:54.174 15:09:58 -- nvmf/common.sh@7 -- # uname -s 00:08:54.174 15:09:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:54.174 15:09:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:54.174 15:09:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:54.174 15:09:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:54.174 15:09:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:54.174 15:09:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:54.174 15:09:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:54.174 15:09:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:54.174 15:09:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:54.174 15:09:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:54.174 15:09:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:08:54.174 15:09:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:08:54.174 15:09:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:54.174 15:09:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:54.174 15:09:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:54.174 15:09:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:54.174 15:09:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:08:54.174 15:09:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:54.174 15:09:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:54.174 15:09:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:54.174 15:09:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.174 15:09:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.174 15:09:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.174 15:09:58 -- paths/export.sh@5 -- # export PATH 00:08:54.174 15:09:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.174 15:09:58 -- nvmf/common.sh@47 -- # : 0 00:08:54.174 15:09:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:54.174 15:09:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:54.174 15:09:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:54.174 15:09:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:54.174 15:09:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:54.174 15:09:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:54.174 15:09:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:54.174 15:09:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:54.174 15:09:58 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:54.174 15:09:58 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:54.174 15:09:58 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:54.174 15:09:58 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:54.174 15:09:58 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:54.174 15:09:58 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:54.174 15:09:58 -- target/referrals.sh@37 -- # nvmftestinit 00:08:54.174 15:09:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:54.174 15:09:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:54.174 15:09:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:54.174 15:09:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:54.174 15:09:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:54.174 15:09:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:54.174 15:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:54.174 15:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:54.174 15:09:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:54.174 15:09:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:54.174 15:09:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:54.174 15:09:58 -- common/autotest_common.sh@10 -- # set +x 00:09:00.748 15:10:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:00.748 15:10:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:00.748 15:10:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:00.748 15:10:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:00.748 15:10:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:00.748 15:10:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:00.748 15:10:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:00.748 15:10:04 -- nvmf/common.sh@295 -- # net_devs=() 00:09:00.748 15:10:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:00.748 15:10:04 -- nvmf/common.sh@296 -- # e810=() 00:09:00.748 15:10:04 -- nvmf/common.sh@296 -- # local -ga e810 00:09:00.748 15:10:04 -- nvmf/common.sh@297 -- # x722=() 00:09:00.748 15:10:04 -- nvmf/common.sh@297 -- # local -ga x722 00:09:00.748 15:10:04 -- nvmf/common.sh@298 -- # mlx=() 00:09:00.748 15:10:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:00.748 15:10:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:00.748 15:10:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:00.748 15:10:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:00.748 15:10:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:00.748 15:10:04 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:00.748 15:10:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:00.748 15:10:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:00.748 15:10:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:09:00.748 Found 0000:18:00.0 (0x8086 - 0x1592) 00:09:00.748 15:10:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:00.748 15:10:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:00.748 15:10:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:09:00.748 Found 0000:18:00.1 (0x8086 - 0x1592) 00:09:00.748 15:10:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:00.748 15:10:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:00.748 15:10:04 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:09:00.748 15:10:04 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:09:00.748 15:10:04 -- nvmf/common.sh@377 -- # modinfo irdma 00:09:00.748 15:10:04 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:09:00.748 15:10:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:00.748 15:10:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.748 15:10:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:00.748 15:10:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.749 15:10:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:09:00.749 Found net devices under 0000:18:00.0: cvl_0_0 00:09:00.749 15:10:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.749 15:10:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.749 15:10:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:00.749 15:10:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.749 15:10:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:09:00.749 Found net devices under 0000:18:00.1: cvl_0_1 00:09:00.749 15:10:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.749 15:10:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:00.749 15:10:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:00.749 15:10:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:00.749 15:10:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:00.749 15:10:04 -- nvmf/common.sh@58 -- # uname 00:09:00.749 15:10:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:00.749 15:10:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:00.749 15:10:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:00.749 15:10:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:00.749 15:10:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:00.749 15:10:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:00.749 15:10:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:00.749 15:10:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:00.749 15:10:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:00.749 15:10:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:00.749 15:10:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:00.749 15:10:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:00.749 15:10:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:00.749 15:10:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:00.749 15:10:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:00.749 15:10:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:00.749 15:10:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:09:00.749 15:10:04 -- nvmf/common.sh@105 -- # continue 2 00:09:00.749 15:10:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.749 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:09:00.749 15:10:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:09:00.749 15:10:04 -- nvmf/common.sh@105 -- # continue 2 00:09:00.749 15:10:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:00.749 15:10:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:09:00.749 15:10:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:09:00.749 15:10:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:09:00.749 15:10:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:00.749 15:10:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:01.008 15:10:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:01.008 15:10:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:09:01.008 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:09:01.008 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:09:01.008 altname enp24s0f0np0 00:09:01.008 altname ens785f0np0 00:09:01.008 inet 192.168.100.8/24 scope global cvl_0_0 00:09:01.008 valid_lft forever preferred_lft forever 00:09:01.008 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:09:01.008 valid_lft forever preferred_lft forever 00:09:01.008 15:10:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:01.008 15:10:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:09:01.008 15:10:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:01.008 15:10:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:01.008 15:10:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:09:01.008 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:09:01.008 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:09:01.008 altname enp24s0f1np1 00:09:01.008 altname ens785f1np1 00:09:01.008 inet 192.168.100.9/24 scope global cvl_0_1 00:09:01.008 valid_lft forever preferred_lft forever 00:09:01.008 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:09:01.008 valid_lft forever preferred_lft forever 00:09:01.008 15:10:04 -- nvmf/common.sh@411 -- # return 0 00:09:01.008 15:10:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:01.008 15:10:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:01.008 15:10:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:01.008 15:10:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:01.008 15:10:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:01.008 15:10:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:01.008 15:10:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:01.008 15:10:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:01.008 15:10:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:01.008 15:10:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:01.008 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:01.008 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:01.008 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:09:01.008 15:10:04 -- nvmf/common.sh@105 -- # continue 2 00:09:01.008 15:10:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:01.008 15:10:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:01.008 15:10:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:09:01.008 15:10:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:09:01.008 15:10:04 -- nvmf/common.sh@105 -- # continue 2 00:09:01.008 15:10:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:01.008 15:10:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:09:01.008 15:10:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:01.008 15:10:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:01.008 15:10:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:01.008 15:10:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:09:01.008 15:10:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:09:01.009 15:10:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:01.009 15:10:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:09:01.009 15:10:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:01.009 15:10:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:01.009 192.168.100.9' 00:09:01.009 15:10:04 -- nvmf/common.sh@446 -- # head -n 1 00:09:01.009 15:10:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:01.009 192.168.100.9' 00:09:01.009 15:10:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:01.009 15:10:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:01.009 192.168.100.9' 00:09:01.009 15:10:04 -- nvmf/common.sh@447 -- # tail -n +2 00:09:01.009 15:10:04 -- nvmf/common.sh@447 -- # head -n 1 00:09:01.009 15:10:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:01.009 15:10:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:01.009 15:10:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:01.009 15:10:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:01.009 15:10:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:01.009 15:10:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:01.009 15:10:04 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:01.009 15:10:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:01.009 15:10:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:01.009 15:10:04 -- common/autotest_common.sh@10 -- # set +x 00:09:01.009 15:10:04 -- nvmf/common.sh@470 -- # nvmfpid=531233 00:09:01.009 15:10:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:01.009 15:10:04 -- nvmf/common.sh@471 -- # waitforlisten 531233 00:09:01.009 15:10:04 -- common/autotest_common.sh@817 -- # '[' -z 531233 ']' 00:09:01.009 15:10:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:01.009 15:10:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:01.009 15:10:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:01.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:01.009 15:10:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:01.009 15:10:04 -- common/autotest_common.sh@10 -- # set +x 00:09:01.009 [2024-04-24 15:10:04.842741] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:09:01.009 [2024-04-24 15:10:04.842795] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:01.009 EAL: No free 2048 kB hugepages reported on node 1 00:09:01.267 [2024-04-24 15:10:04.924742] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:01.267 [2024-04-24 15:10:05.011069] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:01.267 [2024-04-24 15:10:05.011116] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:01.267 [2024-04-24 15:10:05.011126] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:01.267 [2024-04-24 15:10:05.011134] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:01.267 [2024-04-24 15:10:05.011141] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:01.267 [2024-04-24 15:10:05.011243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:01.267 [2024-04-24 15:10:05.011331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:01.267 [2024-04-24 15:10:05.011395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:01.267 [2024-04-24 15:10:05.011396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.836 15:10:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:01.836 15:10:05 -- common/autotest_common.sh@850 -- # return 0 00:09:01.836 15:10:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:01.836 15:10:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:01.836 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:01.836 15:10:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:01.836 15:10:05 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:01.836 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:01.836 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:01.836 [2024-04-24 15:10:05.712153] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x11b2910/0x11b1f50) succeed. 00:09:01.836 [2024-04-24 15:10:05.722597] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x11b3c80/0x11b24d0) succeed. 00:09:01.836 [2024-04-24 15:10:05.722623] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:09:01.836 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:01.836 15:10:05 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:09:01.836 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:01.836 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:01.836 [2024-04-24 15:10:05.734853] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:09:01.836 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:01.836 15:10:05 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:09:01.836 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:01.836 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:01.836 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:01.836 15:10:05 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:09:01.836 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:01.836 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- target/referrals.sh@48 -- # jq length 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:02.096 15:10:05 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:02.096 15:10:05 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.096 15:10:05 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.096 15:10:05 -- target/referrals.sh@21 -- # sort 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:02.096 15:10:05 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:02.096 15:10:05 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.096 15:10:05 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.096 15:10:05 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.096 15:10:05 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.096 15:10:05 -- target/referrals.sh@26 -- # sort 00:09:02.096 15:10:05 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:02.096 15:10:05 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:05 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:09:02.096 15:10:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.096 15:10:05 -- common/autotest_common.sh@10 -- # set +x 00:09:02.096 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.096 15:10:06 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.355 15:10:06 -- target/referrals.sh@56 -- # jq length 00:09:02.355 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.355 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.355 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.355 15:10:06 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:02.355 15:10:06 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:02.355 15:10:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.355 15:10:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.355 15:10:06 -- target/referrals.sh@26 -- # sort 00:09:02.355 15:10:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.355 15:10:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.355 15:10:06 -- target/referrals.sh@26 -- # echo 00:09:02.355 15:10:06 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:02.355 15:10:06 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:09:02.355 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.355 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.355 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.355 15:10:06 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:02.355 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.355 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.355 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.355 15:10:06 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:02.355 15:10:06 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.355 15:10:06 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.355 15:10:06 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.355 15:10:06 -- target/referrals.sh@21 -- # sort 00:09:02.355 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.355 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.355 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.355 15:10:06 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:02.355 15:10:06 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:02.355 15:10:06 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:02.355 15:10:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.355 15:10:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.355 15:10:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.356 15:10:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.356 15:10:06 -- target/referrals.sh@26 -- # sort 00:09:02.616 15:10:06 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:02.616 15:10:06 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:02.616 15:10:06 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:02.616 15:10:06 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:02.616 15:10:06 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:02.616 15:10:06 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.616 15:10:06 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:02.616 15:10:06 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:02.616 15:10:06 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:02.616 15:10:06 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:02.616 15:10:06 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:02.616 15:10:06 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.616 15:10:06 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:02.875 15:10:06 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:02.875 15:10:06 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:02.875 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.875 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.875 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.875 15:10:06 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:02.875 15:10:06 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.875 15:10:06 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.875 15:10:06 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.875 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:02.875 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:02.875 15:10:06 -- target/referrals.sh@21 -- # sort 00:09:02.875 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:02.875 15:10:06 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:02.875 15:10:06 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:02.875 15:10:06 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:02.875 15:10:06 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.875 15:10:06 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.875 15:10:06 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.875 15:10:06 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.875 15:10:06 -- target/referrals.sh@26 -- # sort 00:09:02.875 15:10:06 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:02.875 15:10:06 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:02.875 15:10:06 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:02.875 15:10:06 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:02.875 15:10:06 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:02.875 15:10:06 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:02.875 15:10:06 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:03.134 15:10:06 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:03.134 15:10:06 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:03.134 15:10:06 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:03.134 15:10:06 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:03.134 15:10:06 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:03.134 15:10:06 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:03.134 15:10:06 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:03.134 15:10:06 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:03.134 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.134 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:03.134 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.134 15:10:06 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.134 15:10:06 -- target/referrals.sh@82 -- # jq length 00:09:03.134 15:10:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:03.134 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:09:03.134 15:10:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:03.134 15:10:07 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:03.134 15:10:07 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:03.134 15:10:07 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:03.134 15:10:07 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:03.134 15:10:07 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:03.134 15:10:07 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:03.134 15:10:07 -- target/referrals.sh@26 -- # sort 00:09:03.394 15:10:07 -- target/referrals.sh@26 -- # echo 00:09:03.394 15:10:07 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:03.394 15:10:07 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:03.394 15:10:07 -- target/referrals.sh@86 -- # nvmftestfini 00:09:03.394 15:10:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:03.394 15:10:07 -- nvmf/common.sh@117 -- # sync 00:09:03.394 15:10:07 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:03.394 15:10:07 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:03.394 15:10:07 -- nvmf/common.sh@120 -- # set +e 00:09:03.394 15:10:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:03.394 15:10:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:03.394 rmmod nvme_rdma 00:09:03.394 rmmod nvme_fabrics 00:09:03.394 15:10:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:03.394 15:10:07 -- nvmf/common.sh@124 -- # set -e 00:09:03.394 15:10:07 -- nvmf/common.sh@125 -- # return 0 00:09:03.394 15:10:07 -- nvmf/common.sh@478 -- # '[' -n 531233 ']' 00:09:03.394 15:10:07 -- nvmf/common.sh@479 -- # killprocess 531233 00:09:03.394 15:10:07 -- common/autotest_common.sh@936 -- # '[' -z 531233 ']' 00:09:03.394 15:10:07 -- common/autotest_common.sh@940 -- # kill -0 531233 00:09:03.394 15:10:07 -- common/autotest_common.sh@941 -- # uname 00:09:03.394 15:10:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:03.394 15:10:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 531233 00:09:03.394 15:10:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:03.394 15:10:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:03.394 15:10:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 531233' 00:09:03.394 killing process with pid 531233 00:09:03.394 15:10:07 -- common/autotest_common.sh@955 -- # kill 531233 00:09:03.394 15:10:07 -- common/autotest_common.sh@960 -- # wait 531233 00:09:03.394 [2024-04-24 15:10:07.270816] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:03.654 15:10:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:03.654 15:10:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:03.654 00:09:03.654 real 0m9.554s 00:09:03.654 user 0m12.475s 00:09:03.654 sys 0m6.002s 00:09:03.654 15:10:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:03.654 15:10:07 -- common/autotest_common.sh@10 -- # set +x 00:09:03.654 ************************************ 00:09:03.654 END TEST nvmf_referrals 00:09:03.654 ************************************ 00:09:03.654 15:10:07 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:03.654 15:10:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:03.654 15:10:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:03.654 15:10:07 -- common/autotest_common.sh@10 -- # set +x 00:09:03.914 ************************************ 00:09:03.914 START TEST nvmf_connect_disconnect 00:09:03.914 ************************************ 00:09:03.914 15:10:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:03.914 * Looking for test storage... 00:09:03.914 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:09:03.914 15:10:07 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:09:03.914 15:10:07 -- nvmf/common.sh@7 -- # uname -s 00:09:03.914 15:10:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:03.914 15:10:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:03.914 15:10:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:03.914 15:10:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:03.914 15:10:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:03.914 15:10:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:03.914 15:10:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:03.914 15:10:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:03.914 15:10:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:03.914 15:10:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:03.914 15:10:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:09:03.914 15:10:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:09:03.914 15:10:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:03.914 15:10:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:03.914 15:10:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:03.914 15:10:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:03.914 15:10:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:09:03.914 15:10:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:03.914 15:10:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:03.914 15:10:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:03.914 15:10:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:03.914 15:10:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:03.914 15:10:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:03.914 15:10:07 -- paths/export.sh@5 -- # export PATH 00:09:03.914 15:10:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:03.914 15:10:07 -- nvmf/common.sh@47 -- # : 0 00:09:03.914 15:10:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:03.914 15:10:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:03.914 15:10:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:03.914 15:10:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:03.914 15:10:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:03.914 15:10:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:03.914 15:10:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:03.914 15:10:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:03.914 15:10:07 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:03.914 15:10:07 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:03.914 15:10:07 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:03.914 15:10:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:03.914 15:10:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:03.914 15:10:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:03.914 15:10:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:03.914 15:10:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:03.914 15:10:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:03.914 15:10:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:03.914 15:10:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:04.173 15:10:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:04.173 15:10:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:04.173 15:10:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:04.173 15:10:07 -- common/autotest_common.sh@10 -- # set +x 00:09:10.745 15:10:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:10.745 15:10:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:10.745 15:10:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:10.745 15:10:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:10.745 15:10:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:10.745 15:10:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:10.745 15:10:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:10.745 15:10:14 -- nvmf/common.sh@295 -- # net_devs=() 00:09:10.745 15:10:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:10.745 15:10:14 -- nvmf/common.sh@296 -- # e810=() 00:09:10.745 15:10:14 -- nvmf/common.sh@296 -- # local -ga e810 00:09:10.745 15:10:14 -- nvmf/common.sh@297 -- # x722=() 00:09:10.745 15:10:14 -- nvmf/common.sh@297 -- # local -ga x722 00:09:10.745 15:10:14 -- nvmf/common.sh@298 -- # mlx=() 00:09:10.745 15:10:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:10.745 15:10:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:10.745 15:10:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:09:10.745 Found 0000:18:00.0 (0x8086 - 0x1592) 00:09:10.745 15:10:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:10.745 15:10:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:09:10.745 Found 0000:18:00.1 (0x8086 - 0x1592) 00:09:10.745 15:10:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:10.745 15:10:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@377 -- # modinfo irdma 00:09:10.745 15:10:14 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:09:10.745 15:10:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:10.745 15:10:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:10.745 15:10:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:09:10.745 Found net devices under 0000:18:00.0: cvl_0_0 00:09:10.745 15:10:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:10.745 15:10:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:10.745 15:10:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:09:10.745 Found net devices under 0000:18:00.1: cvl_0_1 00:09:10.745 15:10:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:10.745 15:10:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:10.745 15:10:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:10.745 15:10:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:10.745 15:10:14 -- nvmf/common.sh@58 -- # uname 00:09:10.745 15:10:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:10.745 15:10:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:10.745 15:10:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:10.745 15:10:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:10.745 15:10:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:10.745 15:10:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:10.745 15:10:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:10.745 15:10:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:10.745 15:10:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:10.745 15:10:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:10.745 15:10:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:10.745 15:10:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:10.745 15:10:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:10.745 15:10:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:10.745 15:10:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:10.745 15:10:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:10.745 15:10:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:09:10.745 15:10:14 -- nvmf/common.sh@105 -- # continue 2 00:09:10.745 15:10:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.745 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:09:10.745 15:10:14 -- nvmf/common.sh@105 -- # continue 2 00:09:10.745 15:10:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:10.745 15:10:14 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:09:10.745 15:10:14 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:09:10.745 15:10:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:09:10.745 15:10:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:10.745 15:10:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:10.745 15:10:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:10.745 15:10:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:10.745 15:10:14 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:09:10.745 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:09:10.745 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:09:10.745 altname enp24s0f0np0 00:09:10.745 altname ens785f0np0 00:09:10.745 inet 192.168.100.8/24 scope global cvl_0_0 00:09:10.745 valid_lft forever preferred_lft forever 00:09:10.745 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:09:10.746 valid_lft forever preferred_lft forever 00:09:10.746 15:10:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:10.746 15:10:14 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:10.746 15:10:14 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:10.746 15:10:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:10.746 15:10:14 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:09:10.746 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:09:10.746 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:09:10.746 altname enp24s0f1np1 00:09:10.746 altname ens785f1np1 00:09:10.746 inet 192.168.100.9/24 scope global cvl_0_1 00:09:10.746 valid_lft forever preferred_lft forever 00:09:10.746 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:09:10.746 valid_lft forever preferred_lft forever 00:09:10.746 15:10:14 -- nvmf/common.sh@411 -- # return 0 00:09:10.746 15:10:14 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:10.746 15:10:14 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:10.746 15:10:14 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:10.746 15:10:14 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:10.746 15:10:14 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:10.746 15:10:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:10.746 15:10:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:10.746 15:10:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:10.746 15:10:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:10.746 15:10:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:10.746 15:10:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:10.746 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.746 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:09:10.746 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.746 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:09:10.746 15:10:14 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:09:10.746 15:10:14 -- nvmf/common.sh@105 -- # continue 2 00:09:10.746 15:10:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:10.746 15:10:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:10.746 15:10:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:09:10.746 15:10:14 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@105 -- # continue 2 00:09:10.746 15:10:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:10.746 15:10:14 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:09:10.746 15:10:14 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:10.746 15:10:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:10.746 15:10:14 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:10.746 15:10:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:09:10.746 15:10:14 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:10.746 192.168.100.9' 00:09:10.746 15:10:14 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:10.746 192.168.100.9' 00:09:10.746 15:10:14 -- nvmf/common.sh@446 -- # head -n 1 00:09:10.746 15:10:14 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:10.746 15:10:14 -- nvmf/common.sh@447 -- # tail -n +2 00:09:10.746 15:10:14 -- nvmf/common.sh@447 -- # head -n 1 00:09:10.746 15:10:14 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:10.746 192.168.100.9' 00:09:10.746 15:10:14 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:10.746 15:10:14 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:10.746 15:10:14 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:10.746 15:10:14 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:10.746 15:10:14 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:10.746 15:10:14 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:10.746 15:10:14 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:10.746 15:10:14 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:10.746 15:10:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:10.746 15:10:14 -- common/autotest_common.sh@10 -- # set +x 00:09:10.746 15:10:14 -- nvmf/common.sh@470 -- # nvmfpid=534895 00:09:10.746 15:10:14 -- nvmf/common.sh@471 -- # waitforlisten 534895 00:09:10.746 15:10:14 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:10.746 15:10:14 -- common/autotest_common.sh@817 -- # '[' -z 534895 ']' 00:09:10.746 15:10:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:10.746 15:10:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:10.746 15:10:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:10.746 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:10.746 15:10:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:10.746 15:10:14 -- common/autotest_common.sh@10 -- # set +x 00:09:10.746 [2024-04-24 15:10:14.502271] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:09:10.746 [2024-04-24 15:10:14.502328] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:10.746 EAL: No free 2048 kB hugepages reported on node 1 00:09:10.746 [2024-04-24 15:10:14.583808] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:11.005 [2024-04-24 15:10:14.669233] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:11.005 [2024-04-24 15:10:14.669271] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:11.005 [2024-04-24 15:10:14.669281] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:11.005 [2024-04-24 15:10:14.669290] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:11.005 [2024-04-24 15:10:14.669297] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:11.005 [2024-04-24 15:10:14.669347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:11.005 [2024-04-24 15:10:14.669431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:11.005 [2024-04-24 15:10:14.669521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:11.005 [2024-04-24 15:10:14.669523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:11.573 15:10:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:11.573 15:10:15 -- common/autotest_common.sh@850 -- # return 0 00:09:11.573 15:10:15 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:11.573 15:10:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:11.573 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.573 15:10:15 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:11.573 15:10:15 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:09:11.573 15:10:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.574 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.574 [2024-04-24 15:10:15.351408] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:09:11.574 [2024-04-24 15:10:15.366625] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1f8a910/0x1f89f50) succeed. 00:09:11.574 [2024-04-24 15:10:15.377005] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1f8bc80/0x1f8a4d0) succeed. 00:09:11.574 [2024-04-24 15:10:15.377039] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:09:11.574 15:10:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:11.574 15:10:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.574 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.574 15:10:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:11.574 15:10:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.574 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.574 15:10:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:11.574 15:10:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.574 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.574 15:10:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:11.574 15:10:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:11.574 15:10:15 -- common/autotest_common.sh@10 -- # set +x 00:09:11.574 [2024-04-24 15:10:15.433134] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:11.574 15:10:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:11.574 15:10:15 -- target/connect_disconnect.sh@34 -- # set +x 00:09:14.863 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.759 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.824 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.716 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.627 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.164 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.489 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.470 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.761 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.374 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.825 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.117 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.190 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.605 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.482 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.421 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.950 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.763 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.292 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.823 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.355 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.640 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.355 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.887 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.121 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.713 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.526 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.593 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:26.576 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.406 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:01.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.237 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:10.308 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:12.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.127 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:18.659 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:21.190 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:29.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:32.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:39.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:43.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:43.104 15:14:46 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:43.104 15:14:46 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:43.104 15:14:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:43.104 15:14:46 -- nvmf/common.sh@117 -- # sync 00:13:43.104 15:14:46 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:43.104 15:14:46 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:43.104 15:14:46 -- nvmf/common.sh@120 -- # set +e 00:13:43.104 15:14:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:43.105 15:14:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:43.105 rmmod nvme_rdma 00:13:43.105 rmmod nvme_fabrics 00:13:43.105 15:14:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:43.105 15:14:46 -- nvmf/common.sh@124 -- # set -e 00:13:43.105 15:14:46 -- nvmf/common.sh@125 -- # return 0 00:13:43.105 15:14:46 -- nvmf/common.sh@478 -- # '[' -n 534895 ']' 00:13:43.105 15:14:46 -- nvmf/common.sh@479 -- # killprocess 534895 00:13:43.105 15:14:46 -- common/autotest_common.sh@936 -- # '[' -z 534895 ']' 00:13:43.105 15:14:46 -- common/autotest_common.sh@940 -- # kill -0 534895 00:13:43.105 15:14:46 -- common/autotest_common.sh@941 -- # uname 00:13:43.105 15:14:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:43.105 15:14:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 534895 00:13:43.105 15:14:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:43.105 15:14:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:43.105 15:14:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 534895' 00:13:43.105 killing process with pid 534895 00:13:43.105 15:14:46 -- common/autotest_common.sh@955 -- # kill 534895 00:13:43.105 15:14:46 -- common/autotest_common.sh@960 -- # wait 534895 00:13:43.105 [2024-04-24 15:14:46.616180] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:43.105 15:14:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:43.105 15:14:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:43.105 00:13:43.105 real 4m39.154s 00:13:43.105 user 18m7.586s 00:13:43.105 sys 0m18.502s 00:13:43.105 15:14:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:43.105 15:14:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.105 ************************************ 00:13:43.105 END TEST nvmf_connect_disconnect 00:13:43.105 ************************************ 00:13:43.105 15:14:46 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:13:43.105 15:14:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.105 15:14:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.105 15:14:46 -- common/autotest_common.sh@10 -- # set +x 00:13:43.364 ************************************ 00:13:43.364 START TEST nvmf_multitarget 00:13:43.364 ************************************ 00:13:43.364 15:14:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:13:43.364 * Looking for test storage... 00:13:43.364 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:13:43.364 15:14:47 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.364 15:14:47 -- nvmf/common.sh@7 -- # uname -s 00:13:43.364 15:14:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.364 15:14:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.364 15:14:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.364 15:14:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.364 15:14:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.364 15:14:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.364 15:14:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.364 15:14:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.364 15:14:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.364 15:14:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.364 15:14:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:13:43.364 15:14:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:13:43.364 15:14:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.364 15:14:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.364 15:14:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.364 15:14:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:43.364 15:14:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:13:43.364 15:14:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.364 15:14:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.364 15:14:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.364 15:14:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.364 15:14:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.365 15:14:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.365 15:14:47 -- paths/export.sh@5 -- # export PATH 00:13:43.365 15:14:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.365 15:14:47 -- nvmf/common.sh@47 -- # : 0 00:13:43.365 15:14:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:43.365 15:14:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:43.365 15:14:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:43.365 15:14:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.365 15:14:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.365 15:14:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:43.365 15:14:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:43.365 15:14:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:43.365 15:14:47 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:43.365 15:14:47 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:43.365 15:14:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:43.365 15:14:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.365 15:14:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:43.365 15:14:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:43.365 15:14:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:43.365 15:14:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.365 15:14:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.365 15:14:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.365 15:14:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:43.365 15:14:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:43.365 15:14:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:43.365 15:14:47 -- common/autotest_common.sh@10 -- # set +x 00:13:49.929 15:14:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:49.929 15:14:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:49.929 15:14:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:49.929 15:14:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:49.929 15:14:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:49.929 15:14:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:49.929 15:14:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:49.929 15:14:53 -- nvmf/common.sh@295 -- # net_devs=() 00:13:49.929 15:14:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:49.929 15:14:53 -- nvmf/common.sh@296 -- # e810=() 00:13:49.929 15:14:53 -- nvmf/common.sh@296 -- # local -ga e810 00:13:49.929 15:14:53 -- nvmf/common.sh@297 -- # x722=() 00:13:49.929 15:14:53 -- nvmf/common.sh@297 -- # local -ga x722 00:13:49.929 15:14:53 -- nvmf/common.sh@298 -- # mlx=() 00:13:49.929 15:14:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:49.929 15:14:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:49.929 15:14:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:49.929 15:14:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:49.929 15:14:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:49.929 15:14:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:49.930 15:14:53 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:13:49.930 15:14:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:13:49.930 Found 0000:18:00.0 (0x8086 - 0x1592) 00:13:49.930 15:14:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:49.930 15:14:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:13:49.930 Found 0000:18:00.1 (0x8086 - 0x1592) 00:13:49.930 15:14:53 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:49.930 15:14:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@377 -- # modinfo irdma 00:13:49.930 15:14:53 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:13:49.930 15:14:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.930 15:14:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.930 15:14:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:13:49.930 Found net devices under 0000:18:00.0: cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.930 15:14:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:49.930 15:14:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:49.930 15:14:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:13:49.930 Found net devices under 0000:18:00.1: cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:49.930 15:14:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:49.930 15:14:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:49.930 15:14:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:49.930 15:14:53 -- nvmf/common.sh@58 -- # uname 00:13:49.930 15:14:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:49.930 15:14:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:49.930 15:14:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:49.930 15:14:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:49.930 15:14:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:49.930 15:14:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:49.930 15:14:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:49.930 15:14:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:49.930 15:14:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:49.930 15:14:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:49.930 15:14:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:49.930 15:14:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:49.930 15:14:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:49.930 15:14:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:49.930 15:14:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:49.930 15:14:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@105 -- # continue 2 00:13:49.930 15:14:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@105 -- # continue 2 00:13:49.930 15:14:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:49.930 15:14:53 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:49.930 15:14:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:49.930 15:14:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:13:49.930 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:49.930 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:13:49.930 altname enp24s0f0np0 00:13:49.930 altname ens785f0np0 00:13:49.930 inet 192.168.100.8/24 scope global cvl_0_0 00:13:49.930 valid_lft forever preferred_lft forever 00:13:49.930 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:13:49.930 valid_lft forever preferred_lft forever 00:13:49.930 15:14:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:49.930 15:14:53 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:49.930 15:14:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:49.930 15:14:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:13:49.930 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:13:49.930 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:13:49.930 altname enp24s0f1np1 00:13:49.930 altname ens785f1np1 00:13:49.930 inet 192.168.100.9/24 scope global cvl_0_1 00:13:49.930 valid_lft forever preferred_lft forever 00:13:49.930 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:13:49.930 valid_lft forever preferred_lft forever 00:13:49.930 15:14:53 -- nvmf/common.sh@411 -- # return 0 00:13:49.930 15:14:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:49.930 15:14:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:49.930 15:14:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:49.930 15:14:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:49.930 15:14:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:49.930 15:14:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:49.930 15:14:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:49.930 15:14:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:49.930 15:14:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:49.930 15:14:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@105 -- # continue 2 00:13:49.930 15:14:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:49.930 15:14:53 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:13:49.930 15:14:53 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@105 -- # continue 2 00:13:49.930 15:14:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:49.930 15:14:53 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:49.930 15:14:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:49.930 15:14:53 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:13:49.930 15:14:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:49.930 15:14:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:49.930 192.168.100.9' 00:13:49.930 15:14:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:49.930 192.168.100.9' 00:13:49.930 15:14:53 -- nvmf/common.sh@446 -- # head -n 1 00:13:49.930 15:14:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:49.930 15:14:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:49.930 192.168.100.9' 00:13:49.930 15:14:53 -- nvmf/common.sh@447 -- # tail -n +2 00:13:49.930 15:14:53 -- nvmf/common.sh@447 -- # head -n 1 00:13:49.931 15:14:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:49.931 15:14:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:49.931 15:14:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:49.931 15:14:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:49.931 15:14:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:49.931 15:14:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:49.931 15:14:53 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:49.931 15:14:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:49.931 15:14:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:49.931 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:49.931 15:14:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:49.931 15:14:53 -- nvmf/common.sh@470 -- # nvmfpid=574926 00:13:49.931 15:14:53 -- nvmf/common.sh@471 -- # waitforlisten 574926 00:13:49.931 15:14:53 -- common/autotest_common.sh@817 -- # '[' -z 574926 ']' 00:13:49.931 15:14:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:49.931 15:14:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:49.931 15:14:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:49.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:49.931 15:14:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:49.931 15:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:49.931 [2024-04-24 15:14:53.569340] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:13:49.931 [2024-04-24 15:14:53.569394] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:49.931 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.931 [2024-04-24 15:14:53.650586] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:49.931 [2024-04-24 15:14:53.737788] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.931 [2024-04-24 15:14:53.737834] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.931 [2024-04-24 15:14:53.737844] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:49.931 [2024-04-24 15:14:53.737853] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:49.931 [2024-04-24 15:14:53.737861] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.931 [2024-04-24 15:14:53.737915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.931 [2024-04-24 15:14:53.738000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:49.931 [2024-04-24 15:14:53.738074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.931 [2024-04-24 15:14:53.738076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.498 15:14:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:50.498 15:14:54 -- common/autotest_common.sh@850 -- # return 0 00:13:50.498 15:14:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:50.498 15:14:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:50.498 15:14:54 -- common/autotest_common.sh@10 -- # set +x 00:13:50.756 15:14:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.756 15:14:54 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:50.756 15:14:54 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:50.756 15:14:54 -- target/multitarget.sh@21 -- # jq length 00:13:50.756 15:14:54 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:50.756 15:14:54 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:50.756 "nvmf_tgt_1" 00:13:50.756 15:14:54 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:51.013 "nvmf_tgt_2" 00:13:51.013 15:14:54 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:51.013 15:14:54 -- target/multitarget.sh@28 -- # jq length 00:13:51.013 15:14:54 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:51.013 15:14:54 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:51.272 true 00:13:51.272 15:14:54 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:51.272 true 00:13:51.272 15:14:55 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:51.272 15:14:55 -- target/multitarget.sh@35 -- # jq length 00:13:51.530 15:14:55 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:51.530 15:14:55 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:51.530 15:14:55 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:51.530 15:14:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:51.530 15:14:55 -- nvmf/common.sh@117 -- # sync 00:13:51.530 15:14:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:51.530 15:14:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:51.530 15:14:55 -- nvmf/common.sh@120 -- # set +e 00:13:51.530 15:14:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:51.530 15:14:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:51.530 rmmod nvme_rdma 00:13:51.530 rmmod nvme_fabrics 00:13:51.530 15:14:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:51.530 15:14:55 -- nvmf/common.sh@124 -- # set -e 00:13:51.530 15:14:55 -- nvmf/common.sh@125 -- # return 0 00:13:51.530 15:14:55 -- nvmf/common.sh@478 -- # '[' -n 574926 ']' 00:13:51.530 15:14:55 -- nvmf/common.sh@479 -- # killprocess 574926 00:13:51.530 15:14:55 -- common/autotest_common.sh@936 -- # '[' -z 574926 ']' 00:13:51.530 15:14:55 -- common/autotest_common.sh@940 -- # kill -0 574926 00:13:51.530 15:14:55 -- common/autotest_common.sh@941 -- # uname 00:13:51.530 15:14:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.530 15:14:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 574926 00:13:51.530 15:14:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:51.530 15:14:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:51.531 15:14:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 574926' 00:13:51.531 killing process with pid 574926 00:13:51.531 15:14:55 -- common/autotest_common.sh@955 -- # kill 574926 00:13:51.531 15:14:55 -- common/autotest_common.sh@960 -- # wait 574926 00:13:51.794 15:14:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:51.794 15:14:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:51.794 00:13:51.794 real 0m8.473s 00:13:51.794 user 0m9.551s 00:13:51.794 sys 0m5.366s 00:13:51.794 15:14:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:51.794 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:13:51.794 ************************************ 00:13:51.794 END TEST nvmf_multitarget 00:13:51.794 ************************************ 00:13:51.794 15:14:55 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:13:51.794 15:14:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:51.794 15:14:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:51.794 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:13:52.053 ************************************ 00:13:52.053 START TEST nvmf_rpc 00:13:52.053 ************************************ 00:13:52.053 15:14:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:13:52.053 * Looking for test storage... 00:13:52.053 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:13:52.053 15:14:55 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.053 15:14:55 -- nvmf/common.sh@7 -- # uname -s 00:13:52.053 15:14:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.053 15:14:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.053 15:14:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.053 15:14:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.053 15:14:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.053 15:14:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.053 15:14:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.053 15:14:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.054 15:14:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.054 15:14:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.054 15:14:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:13:52.054 15:14:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:13:52.054 15:14:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.054 15:14:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.054 15:14:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.054 15:14:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:52.054 15:14:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:13:52.054 15:14:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.054 15:14:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.054 15:14:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.054 15:14:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.054 15:14:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.054 15:14:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.054 15:14:55 -- paths/export.sh@5 -- # export PATH 00:13:52.054 15:14:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.054 15:14:55 -- nvmf/common.sh@47 -- # : 0 00:13:52.054 15:14:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:52.054 15:14:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:52.054 15:14:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:52.054 15:14:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.054 15:14:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.054 15:14:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:52.054 15:14:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:52.054 15:14:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:52.054 15:14:55 -- target/rpc.sh@11 -- # loops=5 00:13:52.054 15:14:55 -- target/rpc.sh@23 -- # nvmftestinit 00:13:52.054 15:14:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:52.054 15:14:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.054 15:14:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:52.054 15:14:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:52.054 15:14:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:52.054 15:14:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.054 15:14:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.054 15:14:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.054 15:14:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:52.054 15:14:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:52.054 15:14:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:52.054 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:14:00.177 15:15:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:00.177 15:15:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:00.177 15:15:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:00.177 15:15:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:00.177 15:15:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:00.177 15:15:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:00.177 15:15:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:00.177 15:15:02 -- nvmf/common.sh@295 -- # net_devs=() 00:14:00.177 15:15:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:00.177 15:15:02 -- nvmf/common.sh@296 -- # e810=() 00:14:00.177 15:15:02 -- nvmf/common.sh@296 -- # local -ga e810 00:14:00.177 15:15:02 -- nvmf/common.sh@297 -- # x722=() 00:14:00.177 15:15:02 -- nvmf/common.sh@297 -- # local -ga x722 00:14:00.177 15:15:02 -- nvmf/common.sh@298 -- # mlx=() 00:14:00.177 15:15:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:00.177 15:15:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:00.177 15:15:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:00.177 15:15:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:00.177 15:15:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:00.177 15:15:02 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:00.177 15:15:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:00.177 15:15:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:00.177 15:15:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:14:00.177 Found 0000:18:00.0 (0x8086 - 0x1592) 00:14:00.177 15:15:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:00.177 15:15:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:00.177 15:15:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:14:00.177 Found 0000:18:00.1 (0x8086 - 0x1592) 00:14:00.177 15:15:02 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:00.177 15:15:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:00.177 15:15:02 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:00.177 15:15:02 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:00.177 15:15:02 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:00.177 15:15:02 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:00.177 15:15:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:00.177 15:15:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:00.177 15:15:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:00.177 15:15:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:00.177 15:15:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:14:00.177 Found net devices under 0000:18:00.0: cvl_0_0 00:14:00.177 15:15:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:00.177 15:15:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:00.177 15:15:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:00.177 15:15:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:00.177 15:15:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:00.177 15:15:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:14:00.177 Found net devices under 0000:18:00.1: cvl_0_1 00:14:00.177 15:15:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:00.178 15:15:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:00.178 15:15:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:00.178 15:15:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:00.178 15:15:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:00.178 15:15:02 -- nvmf/common.sh@58 -- # uname 00:14:00.178 15:15:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:00.178 15:15:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:00.178 15:15:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:00.178 15:15:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:00.178 15:15:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:00.178 15:15:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:00.178 15:15:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:00.178 15:15:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:00.178 15:15:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:00.178 15:15:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:00.178 15:15:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:00.178 15:15:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:00.178 15:15:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:00.178 15:15:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:00.178 15:15:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:00.178 15:15:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:00.178 15:15:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@105 -- # continue 2 00:14:00.178 15:15:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@105 -- # continue 2 00:14:00.178 15:15:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:00.178 15:15:02 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:00.178 15:15:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:00.178 15:15:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:00.178 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:00.178 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:14:00.178 altname enp24s0f0np0 00:14:00.178 altname ens785f0np0 00:14:00.178 inet 192.168.100.8/24 scope global cvl_0_0 00:14:00.178 valid_lft forever preferred_lft forever 00:14:00.178 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:14:00.178 valid_lft forever preferred_lft forever 00:14:00.178 15:15:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:00.178 15:15:02 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:00.178 15:15:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:00.178 15:15:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:00.178 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:00.178 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:14:00.178 altname enp24s0f1np1 00:14:00.178 altname ens785f1np1 00:14:00.178 inet 192.168.100.9/24 scope global cvl_0_1 00:14:00.178 valid_lft forever preferred_lft forever 00:14:00.178 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:14:00.178 valid_lft forever preferred_lft forever 00:14:00.178 15:15:02 -- nvmf/common.sh@411 -- # return 0 00:14:00.178 15:15:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:00.178 15:15:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:00.178 15:15:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:00.178 15:15:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:00.178 15:15:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:00.178 15:15:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:00.178 15:15:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:00.178 15:15:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:00.178 15:15:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:00.178 15:15:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@105 -- # continue 2 00:14:00.178 15:15:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:00.178 15:15:02 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:00.178 15:15:02 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@105 -- # continue 2 00:14:00.178 15:15:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:00.178 15:15:02 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:00.178 15:15:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:00.178 15:15:02 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:00.178 15:15:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:00.178 15:15:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:00.178 192.168.100.9' 00:14:00.178 15:15:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:00.178 192.168.100.9' 00:14:00.178 15:15:02 -- nvmf/common.sh@446 -- # head -n 1 00:14:00.178 15:15:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:00.178 15:15:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:00.178 192.168.100.9' 00:14:00.178 15:15:02 -- nvmf/common.sh@447 -- # head -n 1 00:14:00.178 15:15:02 -- nvmf/common.sh@447 -- # tail -n +2 00:14:00.178 15:15:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:00.178 15:15:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:00.178 15:15:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:00.178 15:15:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:00.178 15:15:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:00.178 15:15:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:00.178 15:15:02 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:14:00.178 15:15:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:00.178 15:15:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:00.178 15:15:02 -- common/autotest_common.sh@10 -- # set +x 00:14:00.178 15:15:02 -- nvmf/common.sh@470 -- # nvmfpid=578616 00:14:00.178 15:15:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:00.178 15:15:02 -- nvmf/common.sh@471 -- # waitforlisten 578616 00:14:00.178 15:15:02 -- common/autotest_common.sh@817 -- # '[' -z 578616 ']' 00:14:00.178 15:15:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:00.178 15:15:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:00.178 15:15:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:00.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:00.178 15:15:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:00.178 15:15:02 -- common/autotest_common.sh@10 -- # set +x 00:14:00.178 [2024-04-24 15:15:02.998520] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:14:00.178 [2024-04-24 15:15:02.998584] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:00.178 EAL: No free 2048 kB hugepages reported on node 1 00:14:00.178 [2024-04-24 15:15:03.085057] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:00.178 [2024-04-24 15:15:03.169069] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:00.178 [2024-04-24 15:15:03.169117] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:00.178 [2024-04-24 15:15:03.169127] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:00.178 [2024-04-24 15:15:03.169136] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:00.178 [2024-04-24 15:15:03.169144] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:00.178 [2024-04-24 15:15:03.169202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:00.178 [2024-04-24 15:15:03.169288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:00.178 [2024-04-24 15:15:03.169361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:00.178 [2024-04-24 15:15:03.169363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:00.178 15:15:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:00.178 15:15:03 -- common/autotest_common.sh@850 -- # return 0 00:14:00.178 15:15:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:00.178 15:15:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:00.178 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:00.178 15:15:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:00.179 15:15:03 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:14:00.179 15:15:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.179 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:00.179 15:15:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.179 15:15:03 -- target/rpc.sh@26 -- # stats='{ 00:14:00.179 "tick_rate": 2300000000, 00:14:00.179 "poll_groups": [ 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_0", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_1", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_2", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_3", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [] 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 }' 00:14:00.179 15:15:03 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:14:00.179 15:15:03 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:14:00.179 15:15:03 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:14:00.179 15:15:03 -- target/rpc.sh@15 -- # wc -l 00:14:00.179 15:15:03 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:14:00.179 15:15:03 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:14:00.179 15:15:03 -- target/rpc.sh@29 -- # [[ null == null ]] 00:14:00.179 15:15:03 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:00.179 15:15:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.179 15:15:03 -- common/autotest_common.sh@10 -- # set +x 00:14:00.179 [2024-04-24 15:15:03.996194] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xe74970/0xe73fb0) succeed. 00:14:00.179 [2024-04-24 15:15:04.006526] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xe75ce0/0xe74530) succeed. 00:14:00.179 [2024-04-24 15:15:04.006552] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:00.179 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.179 15:15:04 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:14:00.179 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.179 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.179 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.179 15:15:04 -- target/rpc.sh@33 -- # stats='{ 00:14:00.179 "tick_rate": 2300000000, 00:14:00.179 "poll_groups": [ 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_0", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [ 00:14:00.179 { 00:14:00.179 "trtype": "RDMA", 00:14:00.179 "pending_data_buffer": 0, 00:14:00.179 "devices": [ 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f0", 00:14:00.179 "polls": 1589, 00:14:00.179 "idle_polls": 1589, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f1", 00:14:00.179 "polls": 1589, 00:14:00.179 "idle_polls": 1589, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_1", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [ 00:14:00.179 { 00:14:00.179 "trtype": "RDMA", 00:14:00.179 "pending_data_buffer": 0, 00:14:00.179 "devices": [ 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f0", 00:14:00.179 "polls": 1479, 00:14:00.179 "idle_polls": 1479, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f1", 00:14:00.179 "polls": 1479, 00:14:00.179 "idle_polls": 1479, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_2", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [ 00:14:00.179 { 00:14:00.179 "trtype": "RDMA", 00:14:00.179 "pending_data_buffer": 0, 00:14:00.179 "devices": [ 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f0", 00:14:00.179 "polls": 1391, 00:14:00.179 "idle_polls": 1391, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f1", 00:14:00.179 "polls": 1391, 00:14:00.179 "idle_polls": 1391, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 } 00:14:00.179 ] 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "nvmf_tgt_poll_group_3", 00:14:00.179 "admin_qpairs": 0, 00:14:00.179 "io_qpairs": 0, 00:14:00.179 "current_admin_qpairs": 0, 00:14:00.179 "current_io_qpairs": 0, 00:14:00.179 "pending_bdev_io": 0, 00:14:00.179 "completed_nvme_io": 0, 00:14:00.179 "transports": [ 00:14:00.179 { 00:14:00.179 "trtype": "RDMA", 00:14:00.179 "pending_data_buffer": 0, 00:14:00.179 "devices": [ 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f0", 00:14:00.179 "polls": 1024, 00:14:00.179 "idle_polls": 1024, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.179 "send_doorbell_updates": 0, 00:14:00.179 "total_recv_wrs": 0, 00:14:00.179 "recv_doorbell_updates": 0 00:14:00.179 }, 00:14:00.179 { 00:14:00.179 "name": "rocep24s0f1", 00:14:00.179 "polls": 1024, 00:14:00.179 "idle_polls": 1024, 00:14:00.179 "completions": 0, 00:14:00.179 "requests": 0, 00:14:00.179 "request_latency": 0, 00:14:00.179 "pending_free_request": 0, 00:14:00.179 "pending_rdma_read": 0, 00:14:00.179 "pending_rdma_write": 0, 00:14:00.179 "pending_rdma_send": 0, 00:14:00.179 "total_send_wrs": 0, 00:14:00.180 "send_doorbell_updates": 0, 00:14:00.180 "total_recv_wrs": 0, 00:14:00.180 "recv_doorbell_updates": 0 00:14:00.180 } 00:14:00.180 ] 00:14:00.180 } 00:14:00.180 ] 00:14:00.180 } 00:14:00.180 ] 00:14:00.180 }' 00:14:00.180 15:15:04 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:14:00.180 15:15:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:00.180 15:15:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:00.180 15:15:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:00.439 15:15:04 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:14:00.439 15:15:04 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:14:00.439 15:15:04 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:00.439 15:15:04 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:00.439 15:15:04 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:00.439 15:15:04 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:14:00.439 15:15:04 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:14:00.439 15:15:04 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:14:00.439 15:15:04 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:14:00.439 15:15:04 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:14:00.439 15:15:04 -- target/rpc.sh@15 -- # wc -l 00:14:00.439 15:15:04 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:14:00.439 15:15:04 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:14:00.439 15:15:04 -- target/rpc.sh@41 -- # transport_type=RDMA 00:14:00.439 15:15:04 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:14:00.439 15:15:04 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:14:00.439 15:15:04 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:14:00.439 15:15:04 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:14:00.439 15:15:04 -- target/rpc.sh@15 -- # wc -l 00:14:00.439 15:15:04 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:14:00.439 15:15:04 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:14:00.440 15:15:04 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:14:00.440 15:15:04 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:00.440 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.440 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.440 Malloc1 00:14:00.440 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.440 15:15:04 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:00.440 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.440 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.440 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.440 15:15:04 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:00.440 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.440 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.440 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.440 15:15:04 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:14:00.440 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.440 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.440 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.440 15:15:04 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:00.440 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.440 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.440 [2024-04-24 15:15:04.339361] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:00.440 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.440 15:15:04 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 -a 192.168.100.8 -s 4420 00:14:00.440 15:15:04 -- common/autotest_common.sh@638 -- # local es=0 00:14:00.440 15:15:04 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 -a 192.168.100.8 -s 4420 00:14:00.440 15:15:04 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:00.440 15:15:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:00.440 15:15:04 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:00.440 15:15:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:00.440 15:15:04 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:00.699 15:15:04 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:00.699 15:15:04 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:00.699 15:15:04 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:00.699 15:15:04 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 -a 192.168.100.8 -s 4420 00:14:00.699 [2024-04-24 15:15:04.377260] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712' 00:14:00.699 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:00.699 could not add new controller: failed to write to nvme-fabrics device 00:14:00.699 15:15:04 -- common/autotest_common.sh@641 -- # es=1 00:14:00.699 15:15:04 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:00.699 15:15:04 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:00.699 15:15:04 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:00.699 15:15:04 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:14:00.699 15:15:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:00.699 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:14:00.699 15:15:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:00.699 15:15:04 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:00.958 15:15:04 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:14:00.958 15:15:04 -- common/autotest_common.sh@1184 -- # local i=0 00:14:00.958 15:15:04 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:00.958 15:15:04 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:00.958 15:15:04 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:02.862 15:15:06 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:02.862 15:15:06 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:02.862 15:15:06 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:02.862 15:15:06 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:02.862 15:15:06 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:02.862 15:15:06 -- common/autotest_common.sh@1194 -- # return 0 00:14:02.862 15:15:06 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:03.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:03.799 15:15:07 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:03.799 15:15:07 -- common/autotest_common.sh@1205 -- # local i=0 00:14:03.799 15:15:07 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:03.799 15:15:07 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:03.799 15:15:07 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:03.799 15:15:07 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:03.799 15:15:07 -- common/autotest_common.sh@1217 -- # return 0 00:14:03.799 15:15:07 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:14:03.799 15:15:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:03.799 15:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:03.799 15:15:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:03.799 15:15:07 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:03.799 15:15:07 -- common/autotest_common.sh@638 -- # local es=0 00:14:03.799 15:15:07 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:03.799 15:15:07 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:03.799 15:15:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:03.799 15:15:07 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:03.799 15:15:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:03.799 15:15:07 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:03.799 15:15:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:03.799 15:15:07 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:03.799 15:15:07 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:03.799 15:15:07 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:03.799 [2024-04-24 15:15:07.645804] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712' 00:14:04.059 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:04.059 could not add new controller: failed to write to nvme-fabrics device 00:14:04.059 15:15:07 -- common/autotest_common.sh@641 -- # es=1 00:14:04.059 15:15:07 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:04.059 15:15:07 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:04.059 15:15:07 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:04.059 15:15:07 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:14:04.059 15:15:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:04.059 15:15:07 -- common/autotest_common.sh@10 -- # set +x 00:14:04.059 15:15:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:04.059 15:15:07 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:04.059 15:15:07 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:14:04.059 15:15:07 -- common/autotest_common.sh@1184 -- # local i=0 00:14:04.059 15:15:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:04.059 15:15:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:04.059 15:15:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:06.595 15:15:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:06.595 15:15:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:06.595 15:15:09 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:06.595 15:15:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:06.595 15:15:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:06.595 15:15:09 -- common/autotest_common.sh@1194 -- # return 0 00:14:06.595 15:15:09 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:07.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:07.162 15:15:10 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:07.163 15:15:10 -- common/autotest_common.sh@1205 -- # local i=0 00:14:07.163 15:15:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:07.163 15:15:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:07.163 15:15:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:07.163 15:15:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:07.163 15:15:10 -- common/autotest_common.sh@1217 -- # return 0 00:14:07.163 15:15:10 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:07.163 15:15:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.163 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.163 15:15:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.163 15:15:10 -- target/rpc.sh@81 -- # seq 1 5 00:14:07.163 15:15:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:07.163 15:15:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:07.163 15:15:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.163 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.163 15:15:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.163 15:15:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:07.163 15:15:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.163 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.163 [2024-04-24 15:15:10.878583] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:07.163 15:15:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.163 15:15:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:07.163 15:15:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.163 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.163 15:15:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.163 15:15:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:07.163 15:15:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:07.163 15:15:10 -- common/autotest_common.sh@10 -- # set +x 00:14:07.163 15:15:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:07.163 15:15:10 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:07.422 15:15:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:07.422 15:15:11 -- common/autotest_common.sh@1184 -- # local i=0 00:14:07.422 15:15:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:07.422 15:15:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:07.422 15:15:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:09.326 15:15:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:09.326 15:15:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:09.326 15:15:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:09.326 15:15:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:09.326 15:15:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:09.326 15:15:13 -- common/autotest_common.sh@1194 -- # return 0 00:14:09.326 15:15:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:10.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:10.263 15:15:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:10.263 15:15:14 -- common/autotest_common.sh@1205 -- # local i=0 00:14:10.263 15:15:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:10.263 15:15:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:10.263 15:15:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:10.263 15:15:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:10.263 15:15:14 -- common/autotest_common.sh@1217 -- # return 0 00:14:10.263 15:15:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:10.263 15:15:14 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 [2024-04-24 15:15:14.067722] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:10.263 15:15:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:10.263 15:15:14 -- common/autotest_common.sh@10 -- # set +x 00:14:10.263 15:15:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:10.263 15:15:14 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:10.522 15:15:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:10.522 15:15:14 -- common/autotest_common.sh@1184 -- # local i=0 00:14:10.522 15:15:14 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:10.522 15:15:14 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:10.522 15:15:14 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:12.427 15:15:16 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:12.427 15:15:16 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:12.427 15:15:16 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:12.427 15:15:16 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:12.427 15:15:16 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:12.427 15:15:16 -- common/autotest_common.sh@1194 -- # return 0 00:14:12.427 15:15:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:13.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:13.365 15:15:17 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:13.365 15:15:17 -- common/autotest_common.sh@1205 -- # local i=0 00:14:13.365 15:15:17 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:13.365 15:15:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.365 15:15:17 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:13.365 15:15:17 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:13.365 15:15:17 -- common/autotest_common.sh@1217 -- # return 0 00:14:13.365 15:15:17 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:13.365 15:15:17 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 [2024-04-24 15:15:17.255976] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:13.365 15:15:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:13.365 15:15:17 -- common/autotest_common.sh@10 -- # set +x 00:14:13.365 15:15:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:13.365 15:15:17 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:13.625 15:15:17 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:13.625 15:15:17 -- common/autotest_common.sh@1184 -- # local i=0 00:14:13.625 15:15:17 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:13.625 15:15:17 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:13.625 15:15:17 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:16.162 15:15:19 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:16.162 15:15:19 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:16.162 15:15:19 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:16.162 15:15:19 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:16.162 15:15:19 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:16.162 15:15:19 -- common/autotest_common.sh@1194 -- # return 0 00:14:16.162 15:15:19 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:16.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:16.730 15:15:20 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:16.730 15:15:20 -- common/autotest_common.sh@1205 -- # local i=0 00:14:16.730 15:15:20 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:16.730 15:15:20 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:16.730 15:15:20 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:16.730 15:15:20 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:16.730 15:15:20 -- common/autotest_common.sh@1217 -- # return 0 00:14:16.730 15:15:20 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.730 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.730 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.730 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.730 15:15:20 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:16.730 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.730 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.730 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.730 15:15:20 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:16.730 15:15:20 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:16.730 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.730 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.730 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.730 15:15:20 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:16.730 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.730 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.730 [2024-04-24 15:15:20.420833] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:16.730 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.731 15:15:20 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:16.731 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.731 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.731 15:15:20 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:16.731 15:15:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:16.731 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:14:16.731 15:15:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:16.731 15:15:20 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:16.990 15:15:20 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:16.990 15:15:20 -- common/autotest_common.sh@1184 -- # local i=0 00:14:16.990 15:15:20 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:16.990 15:15:20 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:16.990 15:15:20 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:18.898 15:15:22 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:18.898 15:15:22 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:18.898 15:15:22 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:18.898 15:15:22 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:18.898 15:15:22 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:18.898 15:15:22 -- common/autotest_common.sh@1194 -- # return 0 00:14:18.898 15:15:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:19.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:19.874 15:15:23 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:19.874 15:15:23 -- common/autotest_common.sh@1205 -- # local i=0 00:14:19.874 15:15:23 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:19.874 15:15:23 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:19.874 15:15:23 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:19.874 15:15:23 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:19.874 15:15:23 -- common/autotest_common.sh@1217 -- # return 0 00:14:19.874 15:15:23 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.874 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.874 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.874 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.874 15:15:23 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:19.874 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.874 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.874 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.874 15:15:23 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:19.874 15:15:23 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:19.874 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.874 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.874 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.874 15:15:23 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:19.874 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.874 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.874 [2024-04-24 15:15:23.604015] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:19.875 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.875 15:15:23 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:19.875 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.875 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.875 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.875 15:15:23 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:19.875 15:15:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:19.875 15:15:23 -- common/autotest_common.sh@10 -- # set +x 00:14:19.875 15:15:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:19.875 15:15:23 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:20.205 15:15:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:20.205 15:15:23 -- common/autotest_common.sh@1184 -- # local i=0 00:14:20.205 15:15:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:20.205 15:15:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:20.205 15:15:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:22.112 15:15:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:22.112 15:15:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:22.112 15:15:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:22.112 15:15:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:22.112 15:15:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:22.112 15:15:25 -- common/autotest_common.sh@1194 -- # return 0 00:14:22.112 15:15:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:23.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:23.052 15:15:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:23.052 15:15:26 -- common/autotest_common.sh@1205 -- # local i=0 00:14:23.052 15:15:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:23.052 15:15:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:23.052 15:15:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:23.052 15:15:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:23.052 15:15:26 -- common/autotest_common.sh@1217 -- # return 0 00:14:23.052 15:15:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@99 -- # seq 1 5 00:14:23.052 15:15:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:23.052 15:15:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 [2024-04-24 15:15:26.796788] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:23.052 15:15:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 [2024-04-24 15:15:26.845362] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.052 15:15:26 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:23.052 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.052 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.052 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:23.053 15:15:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 [2024-04-24 15:15:26.893542] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:23.053 15:15:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 [2024-04-24 15:15:26.945746] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.053 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.053 15:15:26 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:23.053 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.053 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:26 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.313 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:26 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.313 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:26 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:14:23.313 15:15:26 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:23.313 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:26 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:23.313 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 [2024-04-24 15:15:26.993917] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:23.313 15:15:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:26 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:23.313 15:15:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:26 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:27 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:23.313 15:15:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.313 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:23.313 15:15:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.313 15:15:27 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.314 15:15:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.314 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:23.314 15:15:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.314 15:15:27 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:23.314 15:15:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.314 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:23.314 15:15:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.314 15:15:27 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:14:23.314 15:15:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:23.314 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:23.314 15:15:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:23.314 15:15:27 -- target/rpc.sh@110 -- # stats='{ 00:14:23.314 "tick_rate": 2300000000, 00:14:23.314 "poll_groups": [ 00:14:23.314 { 00:14:23.314 "name": "nvmf_tgt_poll_group_0", 00:14:23.314 "admin_qpairs": 2, 00:14:23.314 "io_qpairs": 27, 00:14:23.314 "current_admin_qpairs": 0, 00:14:23.314 "current_io_qpairs": 0, 00:14:23.314 "pending_bdev_io": 0, 00:14:23.314 "completed_nvme_io": 77, 00:14:23.314 "transports": [ 00:14:23.314 { 00:14:23.314 "trtype": "RDMA", 00:14:23.314 "pending_data_buffer": 0, 00:14:23.314 "devices": [ 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f0", 00:14:23.314 "polls": 2816223, 00:14:23.314 "idle_polls": 2815871, 00:14:23.314 "completions": 3807, 00:14:23.314 "requests": 3678, 00:14:23.314 "request_latency": 405270656, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 203, 00:14:23.314 "send_doorbell_updates": 116, 00:14:23.314 "total_recv_wrs": 3678, 00:14:23.314 "recv_doorbell_updates": 143 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f1", 00:14:23.314 "polls": 2816223, 00:14:23.314 "idle_polls": 2816223, 00:14:23.314 "completions": 0, 00:14:23.314 "requests": 0, 00:14:23.314 "request_latency": 0, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 0, 00:14:23.314 "send_doorbell_updates": 0, 00:14:23.314 "total_recv_wrs": 0, 00:14:23.314 "recv_doorbell_updates": 0 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "nvmf_tgt_poll_group_1", 00:14:23.314 "admin_qpairs": 2, 00:14:23.314 "io_qpairs": 26, 00:14:23.314 "current_admin_qpairs": 0, 00:14:23.314 "current_io_qpairs": 0, 00:14:23.314 "pending_bdev_io": 0, 00:14:23.314 "completed_nvme_io": 77, 00:14:23.314 "transports": [ 00:14:23.314 { 00:14:23.314 "trtype": "RDMA", 00:14:23.314 "pending_data_buffer": 0, 00:14:23.314 "devices": [ 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f0", 00:14:23.314 "polls": 2805968, 00:14:23.314 "idle_polls": 2805624, 00:14:23.314 "completions": 3644, 00:14:23.314 "requests": 3517, 00:14:23.314 "request_latency": 389045362, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 202, 00:14:23.314 "send_doorbell_updates": 115, 00:14:23.314 "total_recv_wrs": 3517, 00:14:23.314 "recv_doorbell_updates": 141 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f1", 00:14:23.314 "polls": 2805968, 00:14:23.314 "idle_polls": 2805968, 00:14:23.314 "completions": 0, 00:14:23.314 "requests": 0, 00:14:23.314 "request_latency": 0, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 0, 00:14:23.314 "send_doorbell_updates": 0, 00:14:23.314 "total_recv_wrs": 0, 00:14:23.314 "recv_doorbell_updates": 0 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "nvmf_tgt_poll_group_2", 00:14:23.314 "admin_qpairs": 1, 00:14:23.314 "io_qpairs": 26, 00:14:23.314 "current_admin_qpairs": 0, 00:14:23.314 "current_io_qpairs": 0, 00:14:23.314 "pending_bdev_io": 0, 00:14:23.314 "completed_nvme_io": 176, 00:14:23.314 "transports": [ 00:14:23.314 { 00:14:23.314 "trtype": "RDMA", 00:14:23.314 "pending_data_buffer": 0, 00:14:23.314 "devices": [ 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f0", 00:14:23.314 "polls": 2759186, 00:14:23.314 "idle_polls": 2758730, 00:14:23.314 "completions": 3796, 00:14:23.314 "requests": 3593, 00:14:23.314 "request_latency": 420917732, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 365, 00:14:23.314 "send_doorbell_updates": 165, 00:14:23.314 "total_recv_wrs": 3593, 00:14:23.314 "recv_doorbell_updates": 191 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f1", 00:14:23.314 "polls": 2759186, 00:14:23.314 "idle_polls": 2759186, 00:14:23.314 "completions": 0, 00:14:23.314 "requests": 0, 00:14:23.314 "request_latency": 0, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 0, 00:14:23.314 "send_doorbell_updates": 0, 00:14:23.314 "total_recv_wrs": 0, 00:14:23.314 "recv_doorbell_updates": 0 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "nvmf_tgt_poll_group_3", 00:14:23.314 "admin_qpairs": 2, 00:14:23.314 "io_qpairs": 26, 00:14:23.314 "current_admin_qpairs": 0, 00:14:23.314 "current_io_qpairs": 0, 00:14:23.314 "pending_bdev_io": 0, 00:14:23.314 "completed_nvme_io": 125, 00:14:23.314 "transports": [ 00:14:23.314 { 00:14:23.314 "trtype": "RDMA", 00:14:23.314 "pending_data_buffer": 0, 00:14:23.314 "devices": [ 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f0", 00:14:23.314 "polls": 2209421, 00:14:23.314 "idle_polls": 2208998, 00:14:23.314 "completions": 3740, 00:14:23.314 "requests": 3565, 00:14:23.314 "request_latency": 404933036, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 298, 00:14:23.314 "send_doorbell_updates": 154, 00:14:23.314 "total_recv_wrs": 3565, 00:14:23.314 "recv_doorbell_updates": 180 00:14:23.314 }, 00:14:23.314 { 00:14:23.314 "name": "rocep24s0f1", 00:14:23.314 "polls": 2209421, 00:14:23.314 "idle_polls": 2209421, 00:14:23.314 "completions": 0, 00:14:23.314 "requests": 0, 00:14:23.314 "request_latency": 0, 00:14:23.314 "pending_free_request": 0, 00:14:23.314 "pending_rdma_read": 0, 00:14:23.314 "pending_rdma_write": 0, 00:14:23.314 "pending_rdma_send": 0, 00:14:23.314 "total_send_wrs": 0, 00:14:23.314 "send_doorbell_updates": 0, 00:14:23.314 "total_recv_wrs": 0, 00:14:23.314 "recv_doorbell_updates": 0 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 } 00:14:23.314 ] 00:14:23.314 }' 00:14:23.314 15:15:27 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:23.314 15:15:27 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:14:23.314 15:15:27 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:23.314 15:15:27 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:14:23.314 15:15:27 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:14:23.314 15:15:27 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:14:23.314 15:15:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:23.314 15:15:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:14:23.575 15:15:27 -- target/rpc.sh@117 -- # (( 14987 > 0 )) 00:14:23.575 15:15:27 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:14:23.575 15:15:27 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:14:23.575 15:15:27 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:14:23.575 15:15:27 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:23.575 15:15:27 -- target/rpc.sh@118 -- # (( 1620166786 > 0 )) 00:14:23.575 15:15:27 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:14:23.575 15:15:27 -- target/rpc.sh@123 -- # nvmftestfini 00:14:23.575 15:15:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:23.575 15:15:27 -- nvmf/common.sh@117 -- # sync 00:14:23.575 15:15:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:23.575 15:15:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:23.575 15:15:27 -- nvmf/common.sh@120 -- # set +e 00:14:23.575 15:15:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:23.575 15:15:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:23.575 rmmod nvme_rdma 00:14:23.575 rmmod nvme_fabrics 00:14:23.575 15:15:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:23.575 15:15:27 -- nvmf/common.sh@124 -- # set -e 00:14:23.575 15:15:27 -- nvmf/common.sh@125 -- # return 0 00:14:23.575 15:15:27 -- nvmf/common.sh@478 -- # '[' -n 578616 ']' 00:14:23.575 15:15:27 -- nvmf/common.sh@479 -- # killprocess 578616 00:14:23.575 15:15:27 -- common/autotest_common.sh@936 -- # '[' -z 578616 ']' 00:14:23.575 15:15:27 -- common/autotest_common.sh@940 -- # kill -0 578616 00:14:23.575 15:15:27 -- common/autotest_common.sh@941 -- # uname 00:14:23.575 15:15:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:23.575 15:15:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 578616 00:14:23.575 15:15:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:23.575 15:15:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:23.575 15:15:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 578616' 00:14:23.575 killing process with pid 578616 00:14:23.575 15:15:27 -- common/autotest_common.sh@955 -- # kill 578616 00:14:23.575 15:15:27 -- common/autotest_common.sh@960 -- # wait 578616 00:14:23.575 [2024-04-24 15:15:27.390899] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:23.834 15:15:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:23.834 15:15:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:23.835 00:14:23.835 real 0m31.898s 00:14:23.835 user 1m39.899s 00:14:23.835 sys 0m7.343s 00:14:23.835 15:15:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:23.835 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:23.835 ************************************ 00:14:23.835 END TEST nvmf_rpc 00:14:23.835 ************************************ 00:14:23.835 15:15:27 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:14:23.835 15:15:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:23.835 15:15:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:23.835 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:24.093 ************************************ 00:14:24.093 START TEST nvmf_invalid 00:14:24.093 ************************************ 00:14:24.093 15:15:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:14:24.093 * Looking for test storage... 00:14:24.093 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:24.093 15:15:27 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:24.093 15:15:27 -- nvmf/common.sh@7 -- # uname -s 00:14:24.093 15:15:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:24.093 15:15:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:24.093 15:15:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:24.093 15:15:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:24.094 15:15:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:24.094 15:15:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:24.094 15:15:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:24.094 15:15:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:24.094 15:15:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:24.094 15:15:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:24.094 15:15:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:14:24.094 15:15:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:14:24.094 15:15:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:24.094 15:15:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:24.094 15:15:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:24.094 15:15:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:24.094 15:15:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:24.094 15:15:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:24.094 15:15:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:24.094 15:15:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:24.094 15:15:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.094 15:15:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.094 15:15:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.094 15:15:27 -- paths/export.sh@5 -- # export PATH 00:14:24.094 15:15:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:24.094 15:15:27 -- nvmf/common.sh@47 -- # : 0 00:14:24.094 15:15:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:24.094 15:15:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:24.094 15:15:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:24.094 15:15:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:24.094 15:15:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:24.094 15:15:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:24.094 15:15:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:24.094 15:15:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:24.094 15:15:27 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:14:24.094 15:15:27 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:24.094 15:15:27 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:14:24.094 15:15:27 -- target/invalid.sh@14 -- # target=foobar 00:14:24.094 15:15:27 -- target/invalid.sh@16 -- # RANDOM=0 00:14:24.094 15:15:27 -- target/invalid.sh@34 -- # nvmftestinit 00:14:24.094 15:15:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:24.094 15:15:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:24.094 15:15:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:24.094 15:15:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:24.094 15:15:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:24.094 15:15:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.094 15:15:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.094 15:15:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:24.094 15:15:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:24.094 15:15:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:24.094 15:15:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:24.094 15:15:27 -- common/autotest_common.sh@10 -- # set +x 00:14:32.216 15:15:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.216 15:15:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:32.216 15:15:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:32.216 15:15:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:32.216 15:15:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:32.216 15:15:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:32.216 15:15:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:32.216 15:15:35 -- nvmf/common.sh@295 -- # net_devs=() 00:14:32.216 15:15:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:32.216 15:15:35 -- nvmf/common.sh@296 -- # e810=() 00:14:32.216 15:15:35 -- nvmf/common.sh@296 -- # local -ga e810 00:14:32.216 15:15:35 -- nvmf/common.sh@297 -- # x722=() 00:14:32.216 15:15:35 -- nvmf/common.sh@297 -- # local -ga x722 00:14:32.216 15:15:35 -- nvmf/common.sh@298 -- # mlx=() 00:14:32.216 15:15:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:32.216 15:15:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.216 15:15:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:32.216 15:15:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:32.216 15:15:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:32.216 15:15:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:32.216 15:15:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:32.216 15:15:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.216 15:15:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:14:32.216 Found 0000:18:00.0 (0x8086 - 0x1592) 00:14:32.216 15:15:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.216 15:15:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:32.216 15:15:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:14:32.216 Found 0000:18:00.1 (0x8086 - 0x1592) 00:14:32.216 15:15:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:32.216 15:15:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:32.216 15:15:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:32.216 15:15:35 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:32.216 15:15:35 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:32.216 15:15:35 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:32.217 15:15:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.217 15:15:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.217 15:15:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.217 15:15:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:14:32.217 Found net devices under 0000:18:00.0: cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.217 15:15:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.217 15:15:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:32.217 15:15:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.217 15:15:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:14:32.217 Found net devices under 0000:18:00.1: cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.217 15:15:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:32.217 15:15:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:32.217 15:15:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:32.217 15:15:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:32.217 15:15:35 -- nvmf/common.sh@58 -- # uname 00:14:32.217 15:15:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:32.217 15:15:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:32.217 15:15:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:32.217 15:15:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:32.217 15:15:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:32.217 15:15:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:32.217 15:15:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:32.217 15:15:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:32.217 15:15:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:32.217 15:15:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:32.217 15:15:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:32.217 15:15:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.217 15:15:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.217 15:15:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.217 15:15:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.217 15:15:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.217 15:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@105 -- # continue 2 00:14:32.217 15:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@105 -- # continue 2 00:14:32.217 15:15:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.217 15:15:35 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.217 15:15:35 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:32.217 15:15:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:32.217 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:32.217 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:14:32.217 altname enp24s0f0np0 00:14:32.217 altname ens785f0np0 00:14:32.217 inet 192.168.100.8/24 scope global cvl_0_0 00:14:32.217 valid_lft forever preferred_lft forever 00:14:32.217 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:14:32.217 valid_lft forever preferred_lft forever 00:14:32.217 15:15:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:32.217 15:15:35 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.217 15:15:35 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:32.217 15:15:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:32.217 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:32.217 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:14:32.217 altname enp24s0f1np1 00:14:32.217 altname ens785f1np1 00:14:32.217 inet 192.168.100.9/24 scope global cvl_0_1 00:14:32.217 valid_lft forever preferred_lft forever 00:14:32.217 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:14:32.217 valid_lft forever preferred_lft forever 00:14:32.217 15:15:35 -- nvmf/common.sh@411 -- # return 0 00:14:32.217 15:15:35 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:32.217 15:15:35 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:32.217 15:15:35 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:32.217 15:15:35 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:32.217 15:15:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:32.217 15:15:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:32.217 15:15:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:32.217 15:15:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:32.217 15:15:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:32.217 15:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@105 -- # continue 2 00:14:32.217 15:15:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:32.217 15:15:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:32.217 15:15:35 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@105 -- # continue 2 00:14:32.217 15:15:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.217 15:15:35 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.217 15:15:35 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:32.217 15:15:35 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:32.217 15:15:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:32.217 15:15:35 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:32.217 192.168.100.9' 00:14:32.217 15:15:35 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:32.217 192.168.100.9' 00:14:32.217 15:15:35 -- nvmf/common.sh@446 -- # head -n 1 00:14:32.217 15:15:35 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:32.217 15:15:35 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:32.217 192.168.100.9' 00:14:32.217 15:15:35 -- nvmf/common.sh@447 -- # tail -n +2 00:14:32.217 15:15:35 -- nvmf/common.sh@447 -- # head -n 1 00:14:32.217 15:15:35 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:32.217 15:15:35 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:32.217 15:15:35 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:32.217 15:15:35 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:32.217 15:15:35 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:32.217 15:15:35 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:32.217 15:15:35 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:14:32.217 15:15:35 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:32.217 15:15:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:32.217 15:15:35 -- common/autotest_common.sh@10 -- # set +x 00:14:32.217 15:15:35 -- nvmf/common.sh@470 -- # nvmfpid=585719 00:14:32.217 15:15:35 -- nvmf/common.sh@471 -- # waitforlisten 585719 00:14:32.217 15:15:35 -- common/autotest_common.sh@817 -- # '[' -z 585719 ']' 00:14:32.217 15:15:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.217 15:15:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:32.217 15:15:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.217 15:15:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:32.217 15:15:35 -- common/autotest_common.sh@10 -- # set +x 00:14:32.217 15:15:35 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:32.217 [2024-04-24 15:15:35.362968] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:14:32.217 [2024-04-24 15:15:35.363025] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.217 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.217 [2024-04-24 15:15:35.444580] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:32.217 [2024-04-24 15:15:35.530322] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.217 [2024-04-24 15:15:35.530371] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.217 [2024-04-24 15:15:35.530381] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:32.217 [2024-04-24 15:15:35.530389] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:32.218 [2024-04-24 15:15:35.530396] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.218 [2024-04-24 15:15:35.530484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.218 [2024-04-24 15:15:35.530571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:32.218 [2024-04-24 15:15:35.530646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:32.218 [2024-04-24 15:15:35.530648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:32.476 15:15:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:32.476 15:15:36 -- common/autotest_common.sh@850 -- # return 0 00:14:32.476 15:15:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:32.476 15:15:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:32.476 15:15:36 -- common/autotest_common.sh@10 -- # set +x 00:14:32.476 15:15:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:32.476 15:15:36 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:32.476 15:15:36 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode956 00:14:32.736 [2024-04-24 15:15:36.397905] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:14:32.736 15:15:36 -- target/invalid.sh@40 -- # out='request: 00:14:32.736 { 00:14:32.736 "nqn": "nqn.2016-06.io.spdk:cnode956", 00:14:32.736 "tgt_name": "foobar", 00:14:32.736 "method": "nvmf_create_subsystem", 00:14:32.736 "req_id": 1 00:14:32.736 } 00:14:32.736 Got JSON-RPC error response 00:14:32.736 response: 00:14:32.736 { 00:14:32.736 "code": -32603, 00:14:32.736 "message": "Unable to find target foobar" 00:14:32.736 }' 00:14:32.736 15:15:36 -- target/invalid.sh@41 -- # [[ request: 00:14:32.736 { 00:14:32.736 "nqn": "nqn.2016-06.io.spdk:cnode956", 00:14:32.736 "tgt_name": "foobar", 00:14:32.736 "method": "nvmf_create_subsystem", 00:14:32.736 "req_id": 1 00:14:32.736 } 00:14:32.736 Got JSON-RPC error response 00:14:32.736 response: 00:14:32.736 { 00:14:32.736 "code": -32603, 00:14:32.736 "message": "Unable to find target foobar" 00:14:32.736 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:14:32.736 15:15:36 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:14:32.736 15:15:36 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode25604 00:14:32.736 [2024-04-24 15:15:36.586588] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25604: invalid serial number 'SPDKISFASTANDAWESOME' 00:14:32.736 15:15:36 -- target/invalid.sh@45 -- # out='request: 00:14:32.736 { 00:14:32.736 "nqn": "nqn.2016-06.io.spdk:cnode25604", 00:14:32.736 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:32.736 "method": "nvmf_create_subsystem", 00:14:32.736 "req_id": 1 00:14:32.736 } 00:14:32.736 Got JSON-RPC error response 00:14:32.736 response: 00:14:32.736 { 00:14:32.736 "code": -32602, 00:14:32.736 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:32.736 }' 00:14:32.736 15:15:36 -- target/invalid.sh@46 -- # [[ request: 00:14:32.736 { 00:14:32.736 "nqn": "nqn.2016-06.io.spdk:cnode25604", 00:14:32.736 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:14:32.736 "method": "nvmf_create_subsystem", 00:14:32.736 "req_id": 1 00:14:32.736 } 00:14:32.736 Got JSON-RPC error response 00:14:32.736 response: 00:14:32.736 { 00:14:32.736 "code": -32602, 00:14:32.736 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:14:32.736 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:32.736 15:15:36 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:14:32.736 15:15:36 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode6476 00:14:32.995 [2024-04-24 15:15:36.775180] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6476: invalid model number 'SPDK_Controller' 00:14:32.995 15:15:36 -- target/invalid.sh@50 -- # out='request: 00:14:32.995 { 00:14:32.995 "nqn": "nqn.2016-06.io.spdk:cnode6476", 00:14:32.995 "model_number": "SPDK_Controller\u001f", 00:14:32.995 "method": "nvmf_create_subsystem", 00:14:32.995 "req_id": 1 00:14:32.995 } 00:14:32.995 Got JSON-RPC error response 00:14:32.995 response: 00:14:32.995 { 00:14:32.995 "code": -32602, 00:14:32.995 "message": "Invalid MN SPDK_Controller\u001f" 00:14:32.995 }' 00:14:32.995 15:15:36 -- target/invalid.sh@51 -- # [[ request: 00:14:32.995 { 00:14:32.995 "nqn": "nqn.2016-06.io.spdk:cnode6476", 00:14:32.995 "model_number": "SPDK_Controller\u001f", 00:14:32.995 "method": "nvmf_create_subsystem", 00:14:32.995 "req_id": 1 00:14:32.995 } 00:14:32.995 Got JSON-RPC error response 00:14:32.995 response: 00:14:32.995 { 00:14:32.996 "code": -32602, 00:14:32.996 "message": "Invalid MN SPDK_Controller\u001f" 00:14:32.996 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:32.996 15:15:36 -- target/invalid.sh@54 -- # gen_random_s 21 00:14:32.996 15:15:36 -- target/invalid.sh@19 -- # local length=21 ll 00:14:32.996 15:15:36 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:32.996 15:15:36 -- target/invalid.sh@21 -- # local chars 00:14:32.996 15:15:36 -- target/invalid.sh@22 -- # local string 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 108 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=l 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 117 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x75' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=u 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 126 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+='~' 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 79 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=O 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 85 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x55' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=U 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 50 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x32' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=2 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 44 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=, 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 109 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=m 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 100 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x64' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=d 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 37 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x25' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=% 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 121 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x79' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=y 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 43 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=+ 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 94 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+='^' 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # printf %x 101 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x65' 00:14:32.996 15:15:36 -- target/invalid.sh@25 -- # string+=e 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:32.996 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 82 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x52' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+=R 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 119 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x77' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+=w 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 52 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x34' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+=4 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 113 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+=q 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 92 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+='\' 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 115 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x73' 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # string+=s 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.256 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.256 15:15:36 -- target/invalid.sh@25 -- # printf %x 66 00:14:33.257 15:15:36 -- target/invalid.sh@25 -- # echo -e '\x42' 00:14:33.257 15:15:36 -- target/invalid.sh@25 -- # string+=B 00:14:33.257 15:15:36 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.257 15:15:36 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.257 15:15:36 -- target/invalid.sh@28 -- # [[ l == \- ]] 00:14:33.257 15:15:36 -- target/invalid.sh@31 -- # echo 'lu~OU2,md%y+^eRw4q\sB' 00:14:33.257 15:15:36 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'lu~OU2,md%y+^eRw4q\sB' nqn.2016-06.io.spdk:cnode4953 00:14:33.257 [2024-04-24 15:15:37.116325] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4953: invalid serial number 'lu~OU2,md%y+^eRw4q\sB' 00:14:33.257 15:15:37 -- target/invalid.sh@54 -- # out='request: 00:14:33.257 { 00:14:33.257 "nqn": "nqn.2016-06.io.spdk:cnode4953", 00:14:33.257 "serial_number": "lu~OU2,md%y+^eRw4q\\sB", 00:14:33.257 "method": "nvmf_create_subsystem", 00:14:33.257 "req_id": 1 00:14:33.257 } 00:14:33.257 Got JSON-RPC error response 00:14:33.257 response: 00:14:33.257 { 00:14:33.257 "code": -32602, 00:14:33.257 "message": "Invalid SN lu~OU2,md%y+^eRw4q\\sB" 00:14:33.257 }' 00:14:33.257 15:15:37 -- target/invalid.sh@55 -- # [[ request: 00:14:33.257 { 00:14:33.257 "nqn": "nqn.2016-06.io.spdk:cnode4953", 00:14:33.257 "serial_number": "lu~OU2,md%y+^eRw4q\\sB", 00:14:33.257 "method": "nvmf_create_subsystem", 00:14:33.257 "req_id": 1 00:14:33.257 } 00:14:33.257 Got JSON-RPC error response 00:14:33.257 response: 00:14:33.257 { 00:14:33.257 "code": -32602, 00:14:33.257 "message": "Invalid SN lu~OU2,md%y+^eRw4q\\sB" 00:14:33.257 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:14:33.257 15:15:37 -- target/invalid.sh@58 -- # gen_random_s 41 00:14:33.257 15:15:37 -- target/invalid.sh@19 -- # local length=41 ll 00:14:33.257 15:15:37 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:14:33.257 15:15:37 -- target/invalid.sh@21 -- # local chars 00:14:33.257 15:15:37 -- target/invalid.sh@22 -- # local string 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # printf %x 98 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x62' 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # string+=b 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # printf %x 40 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x28' 00:14:33.257 15:15:37 -- target/invalid.sh@25 -- # string+='(' 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.257 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 83 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x53' 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # string+=S 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 72 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x48' 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # string+=H 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 55 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x37' 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # string+=7 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 127 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # string+=$'\177' 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 77 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # string+=M 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.516 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.516 15:15:37 -- target/invalid.sh@25 -- # printf %x 67 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x43' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=C 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 107 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=k 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 65 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x41' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=A 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 124 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='|' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 35 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x23' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='#' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 121 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x79' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=y 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 97 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x61' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=a 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 87 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x57' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=W 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 54 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x36' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=6 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 77 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=M 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 59 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=';' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 97 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x61' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=a 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 33 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x21' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='!' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 64 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x40' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=@ 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 62 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='>' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 64 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x40' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=@ 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 39 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x27' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=\' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 104 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x68' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=h 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 81 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x51' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=Q 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 115 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x73' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=s 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 113 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x71' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=q 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 48 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x30' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=0 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 82 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x52' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=R 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 121 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x79' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=y 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 116 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x74' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=t 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 88 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x58' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=X 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 94 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='^' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 37 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x25' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+=% 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 34 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x22' 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # string+='"' 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.517 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # printf %x 79 00:14:33.517 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # string+=O 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # printf %x 102 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x66' 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # string+=f 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # printf %x 122 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # string+=z 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # printf %x 107 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # string+=k 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # printf %x 52 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # echo -e '\x34' 00:14:33.777 15:15:37 -- target/invalid.sh@25 -- # string+=4 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll++ )) 00:14:33.777 15:15:37 -- target/invalid.sh@24 -- # (( ll < length )) 00:14:33.777 15:15:37 -- target/invalid.sh@28 -- # [[ b == \- ]] 00:14:33.777 15:15:37 -- target/invalid.sh@31 -- # echo 'b(SH7MCkA|#yaW6M;a!@>@'\''hQsq0RytX^%"Ofzk4' 00:14:33.777 15:15:37 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'b(SH7MCkA|#yaW6M;a!@>@'\''hQsq0RytX^%"Ofzk4' nqn.2016-06.io.spdk:cnode18667 00:14:33.777 [2024-04-24 15:15:37.617998] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18667: invalid model number 'b(SH7MCkA|#yaW6M;a!@>@'hQsq0RytX^%"Ofzk4' 00:14:33.777 15:15:37 -- target/invalid.sh@58 -- # out='request: 00:14:33.777 { 00:14:33.777 "nqn": "nqn.2016-06.io.spdk:cnode18667", 00:14:33.777 "model_number": "b(SH7\u007fMCkA|#yaW6M;a!@>@'\''hQsq0RytX^%\"Ofzk4", 00:14:33.777 "method": "nvmf_create_subsystem", 00:14:33.777 "req_id": 1 00:14:33.777 } 00:14:33.777 Got JSON-RPC error response 00:14:33.777 response: 00:14:33.777 { 00:14:33.777 "code": -32602, 00:14:33.777 "message": "Invalid MN b(SH7\u007fMCkA|#yaW6M;a!@>@'\''hQsq0RytX^%\"Ofzk4" 00:14:33.777 }' 00:14:33.777 15:15:37 -- target/invalid.sh@59 -- # [[ request: 00:14:33.777 { 00:14:33.777 "nqn": "nqn.2016-06.io.spdk:cnode18667", 00:14:33.777 "model_number": "b(SH7\u007fMCkA|#yaW6M;a!@>@'hQsq0RytX^%\"Ofzk4", 00:14:33.777 "method": "nvmf_create_subsystem", 00:14:33.777 "req_id": 1 00:14:33.777 } 00:14:33.777 Got JSON-RPC error response 00:14:33.777 response: 00:14:33.777 { 00:14:33.777 "code": -32602, 00:14:33.777 "message": "Invalid MN b(SH7\u007fMCkA|#yaW6M;a!@>@'hQsq0RytX^%\"Ofzk4" 00:14:33.777 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:14:33.777 15:15:37 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:14:34.037 [2024-04-24 15:15:37.822205] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1e8eff0/0x1e8e630) succeed. 00:14:34.037 [2024-04-24 15:15:37.832728] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1e903a0/0x1e8ebb0) succeed. 00:14:34.037 [2024-04-24 15:15:37.832750] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:34.037 [2024-04-24 15:15:37.835472] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:14:34.037 [2024-04-24 15:15:37.835503] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:14:34.037 [2024-04-24 15:15:37.835983] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:14:34.037 [2024-04-24 15:15:37.837203] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:14:34.037 [2024-04-24 15:15:37.837226] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:14:34.037 [2024-04-24 15:15:37.837724] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:14:34.037 [2024-04-24 15:15:37.838883] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 257/767 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:14:34.037 [2024-04-24 15:15:37.838900] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:14:34.037 [2024-04-24 15:15:37.839385] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:14:34.037 15:15:37 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:14:34.296 15:15:38 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:14:34.296 15:15:38 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:14:34.296 192.168.100.9' 00:14:34.296 15:15:38 -- target/invalid.sh@67 -- # head -n 1 00:14:34.296 15:15:38 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:14:34.297 15:15:38 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:14:34.556 [2024-04-24 15:15:38.218280] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:14:34.556 15:15:38 -- target/invalid.sh@69 -- # out='request: 00:14:34.556 { 00:14:34.556 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:34.556 "listen_address": { 00:14:34.556 "trtype": "rdma", 00:14:34.556 "traddr": "192.168.100.8", 00:14:34.556 "trsvcid": "4421" 00:14:34.556 }, 00:14:34.556 "method": "nvmf_subsystem_remove_listener", 00:14:34.556 "req_id": 1 00:14:34.556 } 00:14:34.556 Got JSON-RPC error response 00:14:34.556 response: 00:14:34.556 { 00:14:34.556 "code": -32602, 00:14:34.556 "message": "Invalid parameters" 00:14:34.556 }' 00:14:34.556 15:15:38 -- target/invalid.sh@70 -- # [[ request: 00:14:34.556 { 00:14:34.556 "nqn": "nqn.2016-06.io.spdk:cnode", 00:14:34.556 "listen_address": { 00:14:34.556 "trtype": "rdma", 00:14:34.556 "traddr": "192.168.100.8", 00:14:34.556 "trsvcid": "4421" 00:14:34.556 }, 00:14:34.556 "method": "nvmf_subsystem_remove_listener", 00:14:34.556 "req_id": 1 00:14:34.556 } 00:14:34.556 Got JSON-RPC error response 00:14:34.556 response: 00:14:34.556 { 00:14:34.556 "code": -32602, 00:14:34.556 "message": "Invalid parameters" 00:14:34.556 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:14:34.556 15:15:38 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11902 -i 0 00:14:34.556 [2024-04-24 15:15:38.402875] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11902: invalid cntlid range [0-65519] 00:14:34.556 15:15:38 -- target/invalid.sh@73 -- # out='request: 00:14:34.556 { 00:14:34.556 "nqn": "nqn.2016-06.io.spdk:cnode11902", 00:14:34.556 "min_cntlid": 0, 00:14:34.556 "method": "nvmf_create_subsystem", 00:14:34.556 "req_id": 1 00:14:34.556 } 00:14:34.556 Got JSON-RPC error response 00:14:34.556 response: 00:14:34.556 { 00:14:34.556 "code": -32602, 00:14:34.556 "message": "Invalid cntlid range [0-65519]" 00:14:34.556 }' 00:14:34.556 15:15:38 -- target/invalid.sh@74 -- # [[ request: 00:14:34.556 { 00:14:34.556 "nqn": "nqn.2016-06.io.spdk:cnode11902", 00:14:34.556 "min_cntlid": 0, 00:14:34.556 "method": "nvmf_create_subsystem", 00:14:34.556 "req_id": 1 00:14:34.556 } 00:14:34.556 Got JSON-RPC error response 00:14:34.556 response: 00:14:34.556 { 00:14:34.556 "code": -32602, 00:14:34.556 "message": "Invalid cntlid range [0-65519]" 00:14:34.556 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:34.556 15:15:38 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode13555 -i 65520 00:14:34.815 [2024-04-24 15:15:38.587559] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13555: invalid cntlid range [65520-65519] 00:14:34.815 15:15:38 -- target/invalid.sh@75 -- # out='request: 00:14:34.815 { 00:14:34.815 "nqn": "nqn.2016-06.io.spdk:cnode13555", 00:14:34.815 "min_cntlid": 65520, 00:14:34.815 "method": "nvmf_create_subsystem", 00:14:34.815 "req_id": 1 00:14:34.815 } 00:14:34.815 Got JSON-RPC error response 00:14:34.815 response: 00:14:34.815 { 00:14:34.815 "code": -32602, 00:14:34.815 "message": "Invalid cntlid range [65520-65519]" 00:14:34.815 }' 00:14:34.815 15:15:38 -- target/invalid.sh@76 -- # [[ request: 00:14:34.815 { 00:14:34.815 "nqn": "nqn.2016-06.io.spdk:cnode13555", 00:14:34.815 "min_cntlid": 65520, 00:14:34.815 "method": "nvmf_create_subsystem", 00:14:34.815 "req_id": 1 00:14:34.815 } 00:14:34.815 Got JSON-RPC error response 00:14:34.815 response: 00:14:34.815 { 00:14:34.815 "code": -32602, 00:14:34.815 "message": "Invalid cntlid range [65520-65519]" 00:14:34.815 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:34.815 15:15:38 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode26585 -I 0 00:14:35.074 [2024-04-24 15:15:38.784237] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26585: invalid cntlid range [1-0] 00:14:35.074 15:15:38 -- target/invalid.sh@77 -- # out='request: 00:14:35.074 { 00:14:35.074 "nqn": "nqn.2016-06.io.spdk:cnode26585", 00:14:35.074 "max_cntlid": 0, 00:14:35.074 "method": "nvmf_create_subsystem", 00:14:35.074 "req_id": 1 00:14:35.074 } 00:14:35.074 Got JSON-RPC error response 00:14:35.074 response: 00:14:35.074 { 00:14:35.074 "code": -32602, 00:14:35.074 "message": "Invalid cntlid range [1-0]" 00:14:35.074 }' 00:14:35.074 15:15:38 -- target/invalid.sh@78 -- # [[ request: 00:14:35.074 { 00:14:35.074 "nqn": "nqn.2016-06.io.spdk:cnode26585", 00:14:35.074 "max_cntlid": 0, 00:14:35.074 "method": "nvmf_create_subsystem", 00:14:35.074 "req_id": 1 00:14:35.074 } 00:14:35.074 Got JSON-RPC error response 00:14:35.074 response: 00:14:35.074 { 00:14:35.074 "code": -32602, 00:14:35.074 "message": "Invalid cntlid range [1-0]" 00:14:35.074 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:35.074 15:15:38 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5463 -I 65520 00:14:35.074 [2024-04-24 15:15:38.976971] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5463: invalid cntlid range [1-65520] 00:14:35.333 15:15:39 -- target/invalid.sh@79 -- # out='request: 00:14:35.333 { 00:14:35.333 "nqn": "nqn.2016-06.io.spdk:cnode5463", 00:14:35.333 "max_cntlid": 65520, 00:14:35.333 "method": "nvmf_create_subsystem", 00:14:35.333 "req_id": 1 00:14:35.333 } 00:14:35.333 Got JSON-RPC error response 00:14:35.333 response: 00:14:35.333 { 00:14:35.333 "code": -32602, 00:14:35.333 "message": "Invalid cntlid range [1-65520]" 00:14:35.333 }' 00:14:35.333 15:15:39 -- target/invalid.sh@80 -- # [[ request: 00:14:35.333 { 00:14:35.333 "nqn": "nqn.2016-06.io.spdk:cnode5463", 00:14:35.333 "max_cntlid": 65520, 00:14:35.333 "method": "nvmf_create_subsystem", 00:14:35.333 "req_id": 1 00:14:35.333 } 00:14:35.333 Got JSON-RPC error response 00:14:35.333 response: 00:14:35.333 { 00:14:35.333 "code": -32602, 00:14:35.333 "message": "Invalid cntlid range [1-65520]" 00:14:35.333 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:35.333 15:15:39 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10565 -i 6 -I 5 00:14:35.333 [2024-04-24 15:15:39.161635] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10565: invalid cntlid range [6-5] 00:14:35.333 15:15:39 -- target/invalid.sh@83 -- # out='request: 00:14:35.333 { 00:14:35.333 "nqn": "nqn.2016-06.io.spdk:cnode10565", 00:14:35.333 "min_cntlid": 6, 00:14:35.333 "max_cntlid": 5, 00:14:35.333 "method": "nvmf_create_subsystem", 00:14:35.333 "req_id": 1 00:14:35.333 } 00:14:35.333 Got JSON-RPC error response 00:14:35.333 response: 00:14:35.333 { 00:14:35.333 "code": -32602, 00:14:35.333 "message": "Invalid cntlid range [6-5]" 00:14:35.333 }' 00:14:35.333 15:15:39 -- target/invalid.sh@84 -- # [[ request: 00:14:35.333 { 00:14:35.333 "nqn": "nqn.2016-06.io.spdk:cnode10565", 00:14:35.333 "min_cntlid": 6, 00:14:35.333 "max_cntlid": 5, 00:14:35.333 "method": "nvmf_create_subsystem", 00:14:35.333 "req_id": 1 00:14:35.333 } 00:14:35.333 Got JSON-RPC error response 00:14:35.333 response: 00:14:35.333 { 00:14:35.333 "code": -32602, 00:14:35.333 "message": "Invalid cntlid range [6-5]" 00:14:35.333 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:14:35.333 15:15:39 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:14:35.592 15:15:39 -- target/invalid.sh@87 -- # out='request: 00:14:35.592 { 00:14:35.592 "name": "foobar", 00:14:35.592 "method": "nvmf_delete_target", 00:14:35.592 "req_id": 1 00:14:35.592 } 00:14:35.592 Got JSON-RPC error response 00:14:35.592 response: 00:14:35.592 { 00:14:35.592 "code": -32602, 00:14:35.592 "message": "The specified target doesn'\''t exist, cannot delete it." 00:14:35.592 }' 00:14:35.592 15:15:39 -- target/invalid.sh@88 -- # [[ request: 00:14:35.592 { 00:14:35.592 "name": "foobar", 00:14:35.592 "method": "nvmf_delete_target", 00:14:35.592 "req_id": 1 00:14:35.592 } 00:14:35.592 Got JSON-RPC error response 00:14:35.592 response: 00:14:35.592 { 00:14:35.592 "code": -32602, 00:14:35.592 "message": "The specified target doesn't exist, cannot delete it." 00:14:35.592 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:14:35.592 15:15:39 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:14:35.592 15:15:39 -- target/invalid.sh@91 -- # nvmftestfini 00:14:35.592 15:15:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:35.592 15:15:39 -- nvmf/common.sh@117 -- # sync 00:14:35.592 15:15:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:35.592 15:15:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:35.592 15:15:39 -- nvmf/common.sh@120 -- # set +e 00:14:35.592 15:15:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:35.592 15:15:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:35.592 rmmod nvme_rdma 00:14:35.592 rmmod nvme_fabrics 00:14:35.592 15:15:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:35.592 15:15:39 -- nvmf/common.sh@124 -- # set -e 00:14:35.592 15:15:39 -- nvmf/common.sh@125 -- # return 0 00:14:35.592 15:15:39 -- nvmf/common.sh@478 -- # '[' -n 585719 ']' 00:14:35.592 15:15:39 -- nvmf/common.sh@479 -- # killprocess 585719 00:14:35.592 15:15:39 -- common/autotest_common.sh@936 -- # '[' -z 585719 ']' 00:14:35.592 15:15:39 -- common/autotest_common.sh@940 -- # kill -0 585719 00:14:35.592 15:15:39 -- common/autotest_common.sh@941 -- # uname 00:14:35.592 15:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:35.592 15:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 585719 00:14:35.592 15:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:35.592 15:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:35.592 15:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 585719' 00:14:35.592 killing process with pid 585719 00:14:35.592 15:15:39 -- common/autotest_common.sh@955 -- # kill 585719 00:14:35.592 15:15:39 -- common/autotest_common.sh@960 -- # wait 585719 00:14:35.593 [2024-04-24 15:15:39.422708] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:35.852 15:15:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:35.852 15:15:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:35.852 00:14:35.852 real 0m11.802s 00:14:35.852 user 0m20.513s 00:14:35.852 sys 0m6.827s 00:14:35.852 15:15:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:35.852 15:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:35.852 ************************************ 00:14:35.852 END TEST nvmf_invalid 00:14:35.852 ************************************ 00:14:35.852 15:15:39 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:14:35.852 15:15:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:35.852 15:15:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:35.852 15:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:36.112 ************************************ 00:14:36.112 START TEST nvmf_abort 00:14:36.112 ************************************ 00:14:36.112 15:15:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:14:36.112 * Looking for test storage... 00:14:36.112 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:36.112 15:15:39 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:36.112 15:15:39 -- nvmf/common.sh@7 -- # uname -s 00:14:36.112 15:15:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:36.112 15:15:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:36.112 15:15:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:36.112 15:15:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:36.112 15:15:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:36.112 15:15:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:36.112 15:15:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:36.112 15:15:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:36.112 15:15:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:36.112 15:15:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:36.112 15:15:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:14:36.112 15:15:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:14:36.112 15:15:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:36.112 15:15:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:36.112 15:15:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:36.112 15:15:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:36.112 15:15:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:36.112 15:15:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:36.112 15:15:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:36.112 15:15:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:36.112 15:15:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.112 15:15:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.112 15:15:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.112 15:15:39 -- paths/export.sh@5 -- # export PATH 00:14:36.112 15:15:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:36.112 15:15:39 -- nvmf/common.sh@47 -- # : 0 00:14:36.112 15:15:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:36.112 15:15:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:36.112 15:15:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:36.112 15:15:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:36.112 15:15:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:36.112 15:15:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:36.112 15:15:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:36.112 15:15:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:36.112 15:15:39 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:36.112 15:15:39 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:14:36.112 15:15:39 -- target/abort.sh@14 -- # nvmftestinit 00:14:36.112 15:15:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:36.112 15:15:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:36.112 15:15:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:36.112 15:15:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:36.112 15:15:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:36.112 15:15:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.112 15:15:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.112 15:15:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:36.112 15:15:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:36.112 15:15:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:36.112 15:15:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:36.112 15:15:39 -- common/autotest_common.sh@10 -- # set +x 00:14:44.234 15:15:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:44.234 15:15:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:44.234 15:15:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:44.234 15:15:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:44.234 15:15:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:44.234 15:15:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:44.234 15:15:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:44.234 15:15:47 -- nvmf/common.sh@295 -- # net_devs=() 00:14:44.234 15:15:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:44.234 15:15:47 -- nvmf/common.sh@296 -- # e810=() 00:14:44.235 15:15:47 -- nvmf/common.sh@296 -- # local -ga e810 00:14:44.235 15:15:47 -- nvmf/common.sh@297 -- # x722=() 00:14:44.235 15:15:47 -- nvmf/common.sh@297 -- # local -ga x722 00:14:44.235 15:15:47 -- nvmf/common.sh@298 -- # mlx=() 00:14:44.235 15:15:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:44.235 15:15:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:44.235 15:15:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:14:44.235 Found 0000:18:00.0 (0x8086 - 0x1592) 00:14:44.235 15:15:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:44.235 15:15:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:14:44.235 Found 0000:18:00.1 (0x8086 - 0x1592) 00:14:44.235 15:15:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:44.235 15:15:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:44.235 15:15:47 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:44.235 15:15:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.235 15:15:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.235 15:15:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:14:44.235 Found net devices under 0000:18:00.0: cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.235 15:15:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.235 15:15:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:14:44.235 Found net devices under 0000:18:00.1: cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.235 15:15:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:44.235 15:15:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:44.235 15:15:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:44.235 15:15:47 -- nvmf/common.sh@58 -- # uname 00:14:44.235 15:15:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:44.235 15:15:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:44.235 15:15:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:44.235 15:15:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:44.235 15:15:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:44.235 15:15:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:44.235 15:15:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:44.235 15:15:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:44.235 15:15:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:44.235 15:15:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:44.235 15:15:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:44.235 15:15:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:44.235 15:15:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:44.235 15:15:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:44.235 15:15:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:44.235 15:15:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@105 -- # continue 2 00:14:44.235 15:15:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@105 -- # continue 2 00:14:44.235 15:15:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:44.235 15:15:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:44.235 15:15:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:44.235 15:15:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:44.235 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:44.235 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:14:44.235 altname enp24s0f0np0 00:14:44.235 altname ens785f0np0 00:14:44.235 inet 192.168.100.8/24 scope global cvl_0_0 00:14:44.235 valid_lft forever preferred_lft forever 00:14:44.235 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:14:44.235 valid_lft forever preferred_lft forever 00:14:44.235 15:15:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:44.235 15:15:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:44.235 15:15:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:44.235 15:15:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:44.235 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:44.235 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:14:44.235 altname enp24s0f1np1 00:14:44.235 altname ens785f1np1 00:14:44.235 inet 192.168.100.9/24 scope global cvl_0_1 00:14:44.235 valid_lft forever preferred_lft forever 00:14:44.235 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:14:44.235 valid_lft forever preferred_lft forever 00:14:44.235 15:15:47 -- nvmf/common.sh@411 -- # return 0 00:14:44.235 15:15:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:44.235 15:15:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:44.235 15:15:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:44.235 15:15:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:44.235 15:15:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:44.235 15:15:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:44.235 15:15:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:44.235 15:15:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:44.235 15:15:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:44.235 15:15:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:44.235 15:15:47 -- nvmf/common.sh@105 -- # continue 2 00:14:44.235 15:15:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:44.235 15:15:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:44.235 15:15:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:44.235 15:15:47 -- nvmf/common.sh@105 -- # continue 2 00:14:44.235 15:15:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:44.236 15:15:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:44.236 15:15:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:44.236 15:15:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:44.236 15:15:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:44.236 15:15:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:44.236 15:15:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:44.236 15:15:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:44.236 192.168.100.9' 00:14:44.236 15:15:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:44.236 192.168.100.9' 00:14:44.236 15:15:47 -- nvmf/common.sh@446 -- # head -n 1 00:14:44.236 15:15:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:44.236 15:15:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:44.236 192.168.100.9' 00:14:44.236 15:15:47 -- nvmf/common.sh@447 -- # tail -n +2 00:14:44.236 15:15:47 -- nvmf/common.sh@447 -- # head -n 1 00:14:44.236 15:15:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:44.236 15:15:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:44.236 15:15:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:44.236 15:15:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:44.236 15:15:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:44.236 15:15:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:44.236 15:15:47 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:14:44.236 15:15:47 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:44.236 15:15:47 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:44.236 15:15:47 -- common/autotest_common.sh@10 -- # set +x 00:14:44.236 15:15:47 -- nvmf/common.sh@470 -- # nvmfpid=589798 00:14:44.236 15:15:47 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:44.236 15:15:47 -- nvmf/common.sh@471 -- # waitforlisten 589798 00:14:44.236 15:15:47 -- common/autotest_common.sh@817 -- # '[' -z 589798 ']' 00:14:44.236 15:15:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:44.236 15:15:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:44.236 15:15:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:44.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:44.236 15:15:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:44.236 15:15:47 -- common/autotest_common.sh@10 -- # set +x 00:14:44.236 [2024-04-24 15:15:47.325577] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:14:44.236 [2024-04-24 15:15:47.325637] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:44.236 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.236 [2024-04-24 15:15:47.406807] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:44.236 [2024-04-24 15:15:47.488662] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:44.236 [2024-04-24 15:15:47.488708] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:44.236 [2024-04-24 15:15:47.488718] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:44.236 [2024-04-24 15:15:47.488726] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:44.236 [2024-04-24 15:15:47.488732] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:44.236 [2024-04-24 15:15:47.488840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:44.236 [2024-04-24 15:15:47.488911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:44.236 [2024-04-24 15:15:47.488913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:44.495 15:15:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:44.495 15:15:48 -- common/autotest_common.sh@850 -- # return 0 00:14:44.495 15:15:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:44.495 15:15:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:44.495 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.495 15:15:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:44.495 15:15:48 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:14:44.495 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.495 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.495 [2024-04-24 15:15:48.217952] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x14f70e0/0x14f6720) succeed. 00:14:44.495 [2024-04-24 15:15:48.228187] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x14f8410/0x14f6ca0) succeed. 00:14:44.496 [2024-04-24 15:15:48.228209] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 Malloc0 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 Delay0 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 [2024-04-24 15:15:48.289653] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:44.496 15:15:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:44.496 15:15:48 -- common/autotest_common.sh@10 -- # set +x 00:14:44.496 15:15:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:44.496 15:15:48 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:14:44.496 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.496 [2024-04-24 15:15:48.371568] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:14:47.035 Initializing NVMe Controllers 00:14:47.035 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:14:47.035 controller IO queue size 128 less than required 00:14:47.035 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:14:47.035 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:14:47.035 Initialization complete. Launching workers. 00:14:47.035 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 50033 00:14:47.035 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 50094, failed to submit 62 00:14:47.035 success 50034, unsuccess 60, failed 0 00:14:47.035 15:15:50 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:47.035 15:15:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.035 15:15:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.035 15:15:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.035 15:15:50 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:14:47.035 15:15:50 -- target/abort.sh@38 -- # nvmftestfini 00:14:47.035 15:15:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:47.035 15:15:50 -- nvmf/common.sh@117 -- # sync 00:14:47.035 15:15:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:47.035 15:15:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:47.035 15:15:50 -- nvmf/common.sh@120 -- # set +e 00:14:47.035 15:15:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:47.035 15:15:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:47.035 rmmod nvme_rdma 00:14:47.035 rmmod nvme_fabrics 00:14:47.035 15:15:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:47.035 15:15:50 -- nvmf/common.sh@124 -- # set -e 00:14:47.035 15:15:50 -- nvmf/common.sh@125 -- # return 0 00:14:47.035 15:15:50 -- nvmf/common.sh@478 -- # '[' -n 589798 ']' 00:14:47.035 15:15:50 -- nvmf/common.sh@479 -- # killprocess 589798 00:14:47.035 15:15:50 -- common/autotest_common.sh@936 -- # '[' -z 589798 ']' 00:14:47.035 15:15:50 -- common/autotest_common.sh@940 -- # kill -0 589798 00:14:47.035 15:15:50 -- common/autotest_common.sh@941 -- # uname 00:14:47.035 15:15:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:47.035 15:15:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 589798 00:14:47.035 15:15:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:47.035 15:15:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:47.035 15:15:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 589798' 00:14:47.035 killing process with pid 589798 00:14:47.035 15:15:50 -- common/autotest_common.sh@955 -- # kill 589798 00:14:47.035 15:15:50 -- common/autotest_common.sh@960 -- # wait 589798 00:14:47.035 [2024-04-24 15:15:50.609435] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:47.035 15:15:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:47.035 15:15:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:47.035 00:14:47.035 real 0m11.050s 00:14:47.035 user 0m14.313s 00:14:47.035 sys 0m6.058s 00:14:47.035 15:15:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:47.035 15:15:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.035 ************************************ 00:14:47.035 END TEST nvmf_abort 00:14:47.035 ************************************ 00:14:47.035 15:15:50 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:14:47.035 15:15:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:47.035 15:15:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:47.035 15:15:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.295 ************************************ 00:14:47.295 START TEST nvmf_ns_hotplug_stress 00:14:47.295 ************************************ 00:14:47.295 15:15:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:14:47.295 * Looking for test storage... 00:14:47.295 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:14:47.295 15:15:51 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.295 15:15:51 -- nvmf/common.sh@7 -- # uname -s 00:14:47.295 15:15:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.295 15:15:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.295 15:15:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.295 15:15:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.295 15:15:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.295 15:15:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.295 15:15:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.295 15:15:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.295 15:15:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.295 15:15:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.295 15:15:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:14:47.295 15:15:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:14:47.295 15:15:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.295 15:15:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.295 15:15:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.295 15:15:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:47.295 15:15:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:14:47.295 15:15:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.295 15:15:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.295 15:15:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.295 15:15:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.295 15:15:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.295 15:15:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.295 15:15:51 -- paths/export.sh@5 -- # export PATH 00:14:47.295 15:15:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.295 15:15:51 -- nvmf/common.sh@47 -- # : 0 00:14:47.295 15:15:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:47.295 15:15:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:47.295 15:15:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:47.295 15:15:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.295 15:15:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.295 15:15:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:47.295 15:15:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:47.295 15:15:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:47.554 15:15:51 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:14:47.554 15:15:51 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:14:47.554 15:15:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:47.554 15:15:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.554 15:15:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:47.554 15:15:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:47.554 15:15:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:47.554 15:15:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.554 15:15:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.554 15:15:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.554 15:15:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:47.554 15:15:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:47.554 15:15:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:47.554 15:15:51 -- common/autotest_common.sh@10 -- # set +x 00:14:54.129 15:15:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:54.129 15:15:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:54.129 15:15:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:54.129 15:15:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:54.129 15:15:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:54.129 15:15:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:54.129 15:15:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:54.129 15:15:57 -- nvmf/common.sh@295 -- # net_devs=() 00:14:54.129 15:15:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:54.129 15:15:57 -- nvmf/common.sh@296 -- # e810=() 00:14:54.129 15:15:57 -- nvmf/common.sh@296 -- # local -ga e810 00:14:54.129 15:15:57 -- nvmf/common.sh@297 -- # x722=() 00:14:54.129 15:15:57 -- nvmf/common.sh@297 -- # local -ga x722 00:14:54.129 15:15:57 -- nvmf/common.sh@298 -- # mlx=() 00:14:54.129 15:15:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:54.129 15:15:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:54.129 15:15:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:54.129 15:15:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:54.129 15:15:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:54.129 15:15:57 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:14:54.129 15:15:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:54.129 15:15:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:54.129 15:15:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:14:54.129 Found 0000:18:00.0 (0x8086 - 0x1592) 00:14:54.129 15:15:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:54.129 15:15:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:54.129 15:15:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:14:54.129 Found 0000:18:00.1 (0x8086 - 0x1592) 00:14:54.129 15:15:57 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:54.129 15:15:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:54.129 15:15:57 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:14:54.129 15:15:57 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:14:54.129 15:15:57 -- nvmf/common.sh@377 -- # modinfo irdma 00:14:54.129 15:15:57 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:14:54.129 15:15:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:54.129 15:15:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.129 15:15:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:54.129 15:15:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.129 15:15:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:14:54.129 Found net devices under 0000:18:00.0: cvl_0_0 00:14:54.129 15:15:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.129 15:15:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:54.129 15:15:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:54.129 15:15:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:54.130 15:15:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:54.130 15:15:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:14:54.130 Found net devices under 0000:18:00.1: cvl_0_1 00:14:54.130 15:15:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:54.130 15:15:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:54.130 15:15:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:54.130 15:15:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:54.130 15:15:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:54.130 15:15:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:54.130 15:15:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:54.130 15:15:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:54.130 15:15:57 -- nvmf/common.sh@58 -- # uname 00:14:54.130 15:15:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:54.130 15:15:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:54.130 15:15:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:54.130 15:15:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:54.130 15:15:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:54.130 15:15:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:54.130 15:15:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:54.130 15:15:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:54.130 15:15:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:54.130 15:15:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:54.130 15:15:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:54.130 15:15:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:54.130 15:15:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:54.130 15:15:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:54.130 15:15:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:54.130 15:15:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:54.130 15:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.130 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.130 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:54.130 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.130 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:54.130 15:15:58 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:54.130 15:15:58 -- nvmf/common.sh@105 -- # continue 2 00:14:54.130 15:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.130 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.130 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:54.130 15:15:58 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:54.130 15:15:58 -- nvmf/common.sh@105 -- # continue 2 00:14:54.130 15:15:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:54.130 15:15:58 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:14:54.130 15:15:58 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:54.130 15:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:54.130 15:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.130 15:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.389 15:15:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:54.389 15:15:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:54.389 15:15:58 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:14:54.389 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:54.389 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:14:54.389 altname enp24s0f0np0 00:14:54.389 altname ens785f0np0 00:14:54.389 inet 192.168.100.8/24 scope global cvl_0_0 00:14:54.389 valid_lft forever preferred_lft forever 00:14:54.389 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:14:54.389 valid_lft forever preferred_lft forever 00:14:54.389 15:15:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:54.389 15:15:58 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:14:54.389 15:15:58 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:54.389 15:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.389 15:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:54.389 15:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.389 15:15:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:54.389 15:15:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:54.389 15:15:58 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:14:54.389 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:14:54.389 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:14:54.389 altname enp24s0f1np1 00:14:54.389 altname ens785f1np1 00:14:54.389 inet 192.168.100.9/24 scope global cvl_0_1 00:14:54.389 valid_lft forever preferred_lft forever 00:14:54.389 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:14:54.389 valid_lft forever preferred_lft forever 00:14:54.389 15:15:58 -- nvmf/common.sh@411 -- # return 0 00:14:54.389 15:15:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:54.389 15:15:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:54.389 15:15:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:54.389 15:15:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:54.389 15:15:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:54.389 15:15:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:54.389 15:15:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:54.389 15:15:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:54.389 15:15:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:54.389 15:15:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:54.389 15:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.389 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.389 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:14:54.389 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.389 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:14:54.389 15:15:58 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:14:54.389 15:15:58 -- nvmf/common.sh@105 -- # continue 2 00:14:54.389 15:15:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:54.390 15:15:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:54.390 15:15:58 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:14:54.390 15:15:58 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:14:54.390 15:15:58 -- nvmf/common.sh@105 -- # continue 2 00:14:54.390 15:15:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:54.390 15:15:58 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:14:54.390 15:15:58 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.390 15:15:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:54.390 15:15:58 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:14:54.390 15:15:58 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:54.390 15:15:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:54.390 15:15:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:54.390 192.168.100.9' 00:14:54.390 15:15:58 -- nvmf/common.sh@446 -- # head -n 1 00:14:54.390 15:15:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:54.390 192.168.100.9' 00:14:54.390 15:15:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:54.390 15:15:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:54.390 192.168.100.9' 00:14:54.390 15:15:58 -- nvmf/common.sh@447 -- # tail -n +2 00:14:54.390 15:15:58 -- nvmf/common.sh@447 -- # head -n 1 00:14:54.390 15:15:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:54.390 15:15:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:54.390 15:15:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:54.390 15:15:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:54.390 15:15:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:54.390 15:15:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:54.390 15:15:58 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:14:54.390 15:15:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:54.390 15:15:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:54.390 15:15:58 -- common/autotest_common.sh@10 -- # set +x 00:14:54.390 15:15:58 -- nvmf/common.sh@470 -- # nvmfpid=593541 00:14:54.390 15:15:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:54.390 15:15:58 -- nvmf/common.sh@471 -- # waitforlisten 593541 00:14:54.390 15:15:58 -- common/autotest_common.sh@817 -- # '[' -z 593541 ']' 00:14:54.390 15:15:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:54.390 15:15:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:54.390 15:15:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:54.390 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:54.390 15:15:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:54.390 15:15:58 -- common/autotest_common.sh@10 -- # set +x 00:14:54.390 [2024-04-24 15:15:58.220139] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:14:54.390 [2024-04-24 15:15:58.220193] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:54.390 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.649 [2024-04-24 15:15:58.302982] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:54.649 [2024-04-24 15:15:58.384206] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:54.649 [2024-04-24 15:15:58.384260] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:54.649 [2024-04-24 15:15:58.384269] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:54.649 [2024-04-24 15:15:58.384278] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:54.649 [2024-04-24 15:15:58.384285] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:54.649 [2024-04-24 15:15:58.384339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:54.649 [2024-04-24 15:15:58.384411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:54.649 [2024-04-24 15:15:58.384413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.217 15:15:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:55.217 15:15:59 -- common/autotest_common.sh@850 -- # return 0 00:14:55.217 15:15:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:55.217 15:15:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:55.217 15:15:59 -- common/autotest_common.sh@10 -- # set +x 00:14:55.217 15:15:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.217 15:15:59 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:14:55.217 15:15:59 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:55.476 [2024-04-24 15:15:59.251780] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xdf20e0/0xdf1720) succeed. 00:14:55.476 [2024-04-24 15:15:59.262162] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xdf3410/0xdf1ca0) succeed. 00:14:55.476 [2024-04-24 15:15:59.262189] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:14:55.476 15:15:59 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:55.734 15:15:59 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:55.734 [2024-04-24 15:15:59.627674] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:55.993 15:15:59 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:14:55.993 15:15:59 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:14:56.252 Malloc0 00:14:56.252 15:16:00 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:56.511 Delay0 00:14:56.511 15:16:00 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:56.770 15:16:00 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:56.770 NULL1 00:14:56.770 15:16:00 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:57.029 15:16:00 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:57.029 15:16:00 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=593922 00:14:57.029 15:16:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:14:57.029 15:16:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:57.029 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.405 Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 15:16:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:58.405 15:16:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:14:58.405 15:16:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:58.405 true 00:14:58.664 15:16:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:14:58.664 15:16:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:59.230 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 15:16:03 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:59.489 15:16:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:14:59.489 15:16:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:59.747 true 00:14:59.747 15:16:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:14:59.747 15:16:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 15:16:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:00.684 15:16:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:15:00.684 15:16:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:15:00.943 true 00:15:00.943 15:16:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:00.943 15:16:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 15:16:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:01.879 15:16:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:15:01.879 15:16:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:15:02.136 true 00:15:02.136 15:16:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:02.136 15:16:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:03.071 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 15:16:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:03.072 15:16:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:15:03.072 15:16:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:15:03.331 true 00:15:03.331 15:16:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:03.331 15:16:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:04.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:04.266 15:16:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:04.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:04.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:04.266 15:16:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:15:04.266 15:16:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:15:04.525 true 00:15:04.525 15:16:08 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:04.525 15:16:08 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 15:16:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:05.463 15:16:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:15:05.463 15:16:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:15:05.721 true 00:15:05.721 15:16:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:05.721 15:16:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 15:16:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:06.657 15:16:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:15:06.657 15:16:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:15:06.915 true 00:15:06.915 15:16:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:06.915 15:16:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 15:16:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:07.852 15:16:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:15:07.852 15:16:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:15:08.111 true 00:15:08.111 15:16:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:08.111 15:16:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 15:16:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:09.046 15:16:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:15:09.046 15:16:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:15:09.304 true 00:15:09.304 15:16:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:09.304 15:16:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 15:16:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:10.241 15:16:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:15:10.241 15:16:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:15:10.499 true 00:15:10.499 15:16:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:10.500 15:16:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:11.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.434 15:16:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:11.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.434 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.693 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.693 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:11.693 15:16:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:15:11.693 15:16:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:15:11.693 true 00:15:11.950 15:16:15 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:11.950 15:16:15 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:12.517 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 15:16:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:12.776 15:16:16 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:15:12.776 15:16:16 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:15:13.034 true 00:15:13.034 15:16:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:13.034 15:16:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 15:16:17 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:13.972 15:16:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:15:13.972 15:16:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:15:14.231 true 00:15:14.231 15:16:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:14.231 15:16:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 15:16:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:15.168 15:16:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:15:15.168 15:16:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:15:15.427 true 00:15:15.427 15:16:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:15.427 15:16:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:16.364 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.364 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.365 15:16:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:16.365 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.365 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.365 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.365 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:16.365 15:16:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:15:16.365 15:16:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:15:16.624 true 00:15:16.624 15:16:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:16.624 15:16:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 15:16:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:17.821 15:16:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:15:17.821 15:16:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:15:17.821 true 00:15:17.821 15:16:21 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:17.821 15:16:21 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 15:16:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:18.758 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.017 15:16:22 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:15:19.017 15:16:22 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:15:19.017 true 00:15:19.017 15:16:22 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:19.017 15:16:22 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 15:16:23 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:19.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:20.213 15:16:23 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:15:20.213 15:16:23 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:15:20.213 true 00:15:20.213 15:16:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:20.213 15:16:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 15:16:24 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.151 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:21.411 15:16:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:15:21.411 15:16:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:15:21.411 true 00:15:21.411 15:16:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:21.411 15:16:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 15:16:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.348 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:22.607 15:16:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:15:22.607 15:16:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:15:22.607 true 00:15:22.607 15:16:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:22.607 15:16:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:23.545 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.546 15:16:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:23.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.804 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:23.805 15:16:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:15:23.805 15:16:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:15:24.063 true 00:15:24.063 15:16:27 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:24.063 15:16:27 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 15:16:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:25.000 15:16:28 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:15:25.000 15:16:28 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:15:25.259 true 00:15:25.259 15:16:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:25.259 15:16:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.196 15:16:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.196 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:26.197 15:16:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:15:26.197 15:16:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:15:26.455 true 00:15:26.455 15:16:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:26.455 15:16:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:27.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.392 15:16:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:27.392 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:27.392 15:16:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:15:27.392 15:16:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:15:27.651 true 00:15:27.651 15:16:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:27.651 15:16:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:27.910 15:16:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:27.910 15:16:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:15:27.910 15:16:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:15:28.169 true 00:15:28.169 15:16:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:28.169 15:16:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:28.429 15:16:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:28.429 15:16:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:15:28.429 15:16:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:15:28.687 true 00:15:28.687 15:16:32 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:28.687 15:16:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:28.946 15:16:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:29.206 15:16:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:15:29.206 15:16:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:15:29.206 true 00:15:29.206 15:16:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:29.206 15:16:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:29.206 Initializing NVMe Controllers 00:15:29.206 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:15:29.206 Controller IO queue size 128, less than required. 00:15:29.206 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:29.206 Controller IO queue size 128, less than required. 00:15:29.206 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:29.206 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:29.206 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:15:29.206 Initialization complete. Launching workers. 00:15:29.206 ======================================================== 00:15:29.206 Latency(us) 00:15:29.206 Device Information : IOPS MiB/s Average min max 00:15:29.206 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6062.67 2.96 18491.19 950.49 1137741.45 00:15:29.206 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 34039.73 16.62 3760.29 2147.75 291536.13 00:15:29.206 ======================================================== 00:15:29.206 Total : 40102.40 19.58 5987.30 950.49 1137741.45 00:15:29.206 00:15:29.465 15:16:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:15:29.724 true 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 593922 00:15:29.724 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (593922) - No such process 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@44 -- # wait 593922 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:15:29.724 15:16:33 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:15:29.724 15:16:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:29.724 15:16:33 -- nvmf/common.sh@117 -- # sync 00:15:29.724 15:16:33 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:29.724 15:16:33 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:29.724 15:16:33 -- nvmf/common.sh@120 -- # set +e 00:15:29.724 15:16:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:29.724 15:16:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:29.724 rmmod nvme_rdma 00:15:29.724 rmmod nvme_fabrics 00:15:29.724 15:16:33 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:29.724 15:16:33 -- nvmf/common.sh@124 -- # set -e 00:15:29.724 15:16:33 -- nvmf/common.sh@125 -- # return 0 00:15:29.724 15:16:33 -- nvmf/common.sh@478 -- # '[' -n 593541 ']' 00:15:29.724 15:16:33 -- nvmf/common.sh@479 -- # killprocess 593541 00:15:29.724 15:16:33 -- common/autotest_common.sh@936 -- # '[' -z 593541 ']' 00:15:29.724 15:16:33 -- common/autotest_common.sh@940 -- # kill -0 593541 00:15:29.724 15:16:33 -- common/autotest_common.sh@941 -- # uname 00:15:29.724 15:16:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:29.724 15:16:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 593541 00:15:29.983 15:16:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:29.983 15:16:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:29.983 15:16:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 593541' 00:15:29.983 killing process with pid 593541 00:15:29.983 15:16:33 -- common/autotest_common.sh@955 -- # kill 593541 00:15:29.983 15:16:33 -- common/autotest_common.sh@960 -- # wait 593541 00:15:29.983 [2024-04-24 15:16:33.693423] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:30.273 15:16:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:30.273 15:16:33 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:30.273 00:15:30.273 real 0m42.872s 00:15:30.273 user 2m34.459s 00:15:30.273 sys 0m9.225s 00:15:30.273 15:16:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:30.273 15:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:30.273 ************************************ 00:15:30.273 END TEST nvmf_ns_hotplug_stress 00:15:30.273 ************************************ 00:15:30.273 15:16:33 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:15:30.273 15:16:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:30.273 15:16:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:30.273 15:16:33 -- common/autotest_common.sh@10 -- # set +x 00:15:30.273 ************************************ 00:15:30.273 START TEST nvmf_connect_stress 00:15:30.273 ************************************ 00:15:30.273 15:16:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:15:30.556 * Looking for test storage... 00:15:30.556 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:15:30.556 15:16:34 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:15:30.556 15:16:34 -- nvmf/common.sh@7 -- # uname -s 00:15:30.556 15:16:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:30.556 15:16:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:30.556 15:16:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:30.556 15:16:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:30.556 15:16:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:30.556 15:16:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:30.556 15:16:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:30.556 15:16:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:30.556 15:16:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:30.556 15:16:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:30.556 15:16:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:15:30.556 15:16:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:15:30.556 15:16:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:30.556 15:16:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:30.556 15:16:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:30.556 15:16:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:30.556 15:16:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:15:30.556 15:16:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:30.556 15:16:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:30.556 15:16:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:30.556 15:16:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.556 15:16:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.556 15:16:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.556 15:16:34 -- paths/export.sh@5 -- # export PATH 00:15:30.556 15:16:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.556 15:16:34 -- nvmf/common.sh@47 -- # : 0 00:15:30.556 15:16:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:30.556 15:16:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:30.556 15:16:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:30.556 15:16:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:30.556 15:16:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:30.556 15:16:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:30.556 15:16:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:30.556 15:16:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:30.556 15:16:34 -- target/connect_stress.sh@12 -- # nvmftestinit 00:15:30.556 15:16:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:30.556 15:16:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:30.556 15:16:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:30.556 15:16:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:30.556 15:16:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:30.556 15:16:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.556 15:16:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.556 15:16:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.556 15:16:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:30.556 15:16:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:30.556 15:16:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:30.556 15:16:34 -- common/autotest_common.sh@10 -- # set +x 00:15:37.222 15:16:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:37.222 15:16:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:37.222 15:16:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:37.222 15:16:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:37.222 15:16:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:37.222 15:16:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:37.222 15:16:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:37.222 15:16:40 -- nvmf/common.sh@295 -- # net_devs=() 00:15:37.222 15:16:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:37.222 15:16:40 -- nvmf/common.sh@296 -- # e810=() 00:15:37.222 15:16:40 -- nvmf/common.sh@296 -- # local -ga e810 00:15:37.222 15:16:40 -- nvmf/common.sh@297 -- # x722=() 00:15:37.222 15:16:40 -- nvmf/common.sh@297 -- # local -ga x722 00:15:37.222 15:16:40 -- nvmf/common.sh@298 -- # mlx=() 00:15:37.222 15:16:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:37.222 15:16:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:37.222 15:16:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:15:37.222 Found 0000:18:00.0 (0x8086 - 0x1592) 00:15:37.222 15:16:40 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:37.222 15:16:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:15:37.222 Found 0000:18:00.1 (0x8086 - 0x1592) 00:15:37.222 15:16:40 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:37.222 15:16:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@377 -- # modinfo irdma 00:15:37.222 15:16:40 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:15:37.222 15:16:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:37.222 15:16:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:37.222 15:16:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:15:37.222 Found net devices under 0000:18:00.0: cvl_0_0 00:15:37.222 15:16:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:37.222 15:16:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:37.222 15:16:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:15:37.222 Found net devices under 0000:18:00.1: cvl_0_1 00:15:37.222 15:16:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:37.222 15:16:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:37.222 15:16:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:37.222 15:16:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:37.222 15:16:40 -- nvmf/common.sh@58 -- # uname 00:15:37.222 15:16:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:37.222 15:16:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:37.222 15:16:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:37.222 15:16:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:37.222 15:16:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:37.222 15:16:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:37.222 15:16:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:37.222 15:16:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:37.222 15:16:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:37.222 15:16:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:37.222 15:16:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:37.222 15:16:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:37.222 15:16:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:37.222 15:16:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:37.222 15:16:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:37.222 15:16:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:37.222 15:16:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:37.222 15:16:40 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:37.222 15:16:40 -- nvmf/common.sh@105 -- # continue 2 00:15:37.222 15:16:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:37.222 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@105 -- # continue 2 00:15:37.223 15:16:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:37.223 15:16:40 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:37.223 15:16:40 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:37.223 15:16:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:15:37.223 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:37.223 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:15:37.223 altname enp24s0f0np0 00:15:37.223 altname ens785f0np0 00:15:37.223 inet 192.168.100.8/24 scope global cvl_0_0 00:15:37.223 valid_lft forever preferred_lft forever 00:15:37.223 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:15:37.223 valid_lft forever preferred_lft forever 00:15:37.223 15:16:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:37.223 15:16:40 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:37.223 15:16:40 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:37.223 15:16:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:15:37.223 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:37.223 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:15:37.223 altname enp24s0f1np1 00:15:37.223 altname ens785f1np1 00:15:37.223 inet 192.168.100.9/24 scope global cvl_0_1 00:15:37.223 valid_lft forever preferred_lft forever 00:15:37.223 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:15:37.223 valid_lft forever preferred_lft forever 00:15:37.223 15:16:40 -- nvmf/common.sh@411 -- # return 0 00:15:37.223 15:16:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:37.223 15:16:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:37.223 15:16:40 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:37.223 15:16:40 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:37.223 15:16:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:37.223 15:16:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:37.223 15:16:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:37.223 15:16:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:37.223 15:16:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:37.223 15:16:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@105 -- # continue 2 00:15:37.223 15:16:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:37.223 15:16:40 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:37.223 15:16:40 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@105 -- # continue 2 00:15:37.223 15:16:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:37.223 15:16:40 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:37.223 15:16:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:37.223 15:16:40 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:37.223 15:16:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:37.223 15:16:40 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:37.223 192.168.100.9' 00:15:37.223 15:16:40 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:37.223 192.168.100.9' 00:15:37.223 15:16:40 -- nvmf/common.sh@446 -- # head -n 1 00:15:37.223 15:16:40 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:37.223 15:16:40 -- nvmf/common.sh@447 -- # head -n 1 00:15:37.223 15:16:40 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:37.223 192.168.100.9' 00:15:37.223 15:16:40 -- nvmf/common.sh@447 -- # tail -n +2 00:15:37.223 15:16:40 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:37.223 15:16:40 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:37.223 15:16:40 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:37.223 15:16:40 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:37.223 15:16:40 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:37.223 15:16:40 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:37.223 15:16:40 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:15:37.223 15:16:40 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:37.223 15:16:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:37.223 15:16:40 -- common/autotest_common.sh@10 -- # set +x 00:15:37.223 15:16:40 -- nvmf/common.sh@470 -- # nvmfpid=601569 00:15:37.223 15:16:40 -- nvmf/common.sh@471 -- # waitforlisten 601569 00:15:37.223 15:16:40 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:37.223 15:16:40 -- common/autotest_common.sh@817 -- # '[' -z 601569 ']' 00:15:37.223 15:16:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:37.223 15:16:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:37.223 15:16:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:37.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:37.223 15:16:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:37.223 15:16:40 -- common/autotest_common.sh@10 -- # set +x 00:15:37.223 [2024-04-24 15:16:41.038860] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:15:37.223 [2024-04-24 15:16:41.038916] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:37.223 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.223 [2024-04-24 15:16:41.119030] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:37.482 [2024-04-24 15:16:41.204642] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:37.482 [2024-04-24 15:16:41.204697] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:37.482 [2024-04-24 15:16:41.204706] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:37.482 [2024-04-24 15:16:41.204714] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:37.482 [2024-04-24 15:16:41.204721] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:37.482 [2024-04-24 15:16:41.204827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:37.482 [2024-04-24 15:16:41.204900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:37.482 [2024-04-24 15:16:41.204901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:38.048 15:16:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:38.048 15:16:41 -- common/autotest_common.sh@850 -- # return 0 00:15:38.048 15:16:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:38.048 15:16:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:38.048 15:16:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.048 15:16:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:38.048 15:16:41 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:38.048 15:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.048 15:16:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.048 [2024-04-24 15:16:41.921806] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x16f00e0/0x16ef720) succeed. 00:15:38.048 [2024-04-24 15:16:41.932105] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x16f1410/0x16efca0) succeed. 00:15:38.048 [2024-04-24 15:16:41.932129] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:15:38.048 15:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.048 15:16:41 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:38.048 15:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.048 15:16:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.048 15:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.048 15:16:41 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:38.048 15:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.048 15:16:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.048 [2024-04-24 15:16:41.952358] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:38.048 15:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.048 15:16:41 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:38.048 15:16:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.048 15:16:41 -- common/autotest_common.sh@10 -- # set +x 00:15:38.307 NULL1 00:15:38.307 15:16:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.307 15:16:41 -- target/connect_stress.sh@21 -- # PERF_PID=601684 00:15:38.307 15:16:41 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:38.307 15:16:41 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:38.307 15:16:41 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # seq 1 20 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:41 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:41 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:41 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:41 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:41 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:41 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:38.307 15:16:42 -- target/connect_stress.sh@28 -- # cat 00:15:38.307 15:16:42 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:38.307 15:16:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:38.307 15:16:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.307 15:16:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.566 15:16:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.566 15:16:42 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:38.566 15:16:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:38.566 15:16:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.566 15:16:42 -- common/autotest_common.sh@10 -- # set +x 00:15:38.824 15:16:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:38.824 15:16:42 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:38.824 15:16:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:38.824 15:16:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:38.824 15:16:42 -- common/autotest_common.sh@10 -- # set +x 00:15:39.391 15:16:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:39.391 15:16:43 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:39.391 15:16:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:39.391 15:16:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:39.391 15:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:39.649 15:16:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:39.649 15:16:43 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:39.649 15:16:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:39.649 15:16:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:39.649 15:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:39.908 15:16:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:39.908 15:16:43 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:39.908 15:16:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:39.908 15:16:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:39.908 15:16:43 -- common/autotest_common.sh@10 -- # set +x 00:15:40.166 15:16:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:40.166 15:16:44 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:40.166 15:16:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:40.166 15:16:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:40.166 15:16:44 -- common/autotest_common.sh@10 -- # set +x 00:15:40.733 15:16:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:40.733 15:16:44 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:40.733 15:16:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:40.733 15:16:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:40.733 15:16:44 -- common/autotest_common.sh@10 -- # set +x 00:15:40.992 15:16:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:40.992 15:16:44 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:40.992 15:16:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:40.992 15:16:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:40.992 15:16:44 -- common/autotest_common.sh@10 -- # set +x 00:15:41.251 15:16:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:41.251 15:16:44 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:41.251 15:16:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:41.251 15:16:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:41.251 15:16:44 -- common/autotest_common.sh@10 -- # set +x 00:15:41.510 15:16:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:41.510 15:16:45 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:41.510 15:16:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:41.510 15:16:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:41.510 15:16:45 -- common/autotest_common.sh@10 -- # set +x 00:15:41.769 15:16:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:41.769 15:16:45 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:41.769 15:16:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:41.769 15:16:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:41.769 15:16:45 -- common/autotest_common.sh@10 -- # set +x 00:15:42.337 15:16:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:42.337 15:16:45 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:42.337 15:16:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:42.337 15:16:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:42.337 15:16:45 -- common/autotest_common.sh@10 -- # set +x 00:15:42.596 15:16:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:42.596 15:16:46 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:42.596 15:16:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:42.596 15:16:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:42.596 15:16:46 -- common/autotest_common.sh@10 -- # set +x 00:15:42.855 15:16:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:42.855 15:16:46 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:42.855 15:16:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:42.855 15:16:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:42.855 15:16:46 -- common/autotest_common.sh@10 -- # set +x 00:15:43.114 15:16:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:43.114 15:16:46 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:43.114 15:16:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:43.114 15:16:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:43.114 15:16:46 -- common/autotest_common.sh@10 -- # set +x 00:15:43.682 15:16:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:43.682 15:16:47 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:43.682 15:16:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:43.682 15:16:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:43.682 15:16:47 -- common/autotest_common.sh@10 -- # set +x 00:15:43.941 15:16:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:43.941 15:16:47 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:43.941 15:16:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:43.941 15:16:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:43.941 15:16:47 -- common/autotest_common.sh@10 -- # set +x 00:15:44.200 15:16:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:44.200 15:16:47 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:44.200 15:16:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:44.200 15:16:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:44.200 15:16:47 -- common/autotest_common.sh@10 -- # set +x 00:15:44.459 15:16:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:44.459 15:16:48 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:44.459 15:16:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:44.459 15:16:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:44.459 15:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:44.718 15:16:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:44.718 15:16:48 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:44.718 15:16:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:44.718 15:16:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:44.718 15:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:45.285 15:16:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:45.285 15:16:48 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:45.285 15:16:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:45.285 15:16:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:45.285 15:16:48 -- common/autotest_common.sh@10 -- # set +x 00:15:45.544 15:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:45.544 15:16:49 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:45.544 15:16:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:45.544 15:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:45.544 15:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:45.803 15:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:45.803 15:16:49 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:45.803 15:16:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:45.803 15:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:45.803 15:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:46.063 15:16:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:46.063 15:16:49 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:46.063 15:16:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:46.063 15:16:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:46.063 15:16:49 -- common/autotest_common.sh@10 -- # set +x 00:15:46.322 15:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:46.322 15:16:50 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:46.322 15:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:46.322 15:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:46.322 15:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:46.890 15:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:46.890 15:16:50 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:46.890 15:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:46.890 15:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:46.890 15:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:47.150 15:16:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:47.150 15:16:50 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:47.150 15:16:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:47.150 15:16:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:47.150 15:16:50 -- common/autotest_common.sh@10 -- # set +x 00:15:47.409 15:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:47.409 15:16:51 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:47.409 15:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:47.409 15:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:47.409 15:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:47.668 15:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:47.668 15:16:51 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:47.668 15:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:47.668 15:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:47.668 15:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.236 15:16:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.236 15:16:51 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:48.236 15:16:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:48.236 15:16:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:48.236 15:16:51 -- common/autotest_common.sh@10 -- # set +x 00:15:48.236 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:15:48.495 15:16:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:48.495 15:16:52 -- target/connect_stress.sh@34 -- # kill -0 601684 00:15:48.496 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (601684) - No such process 00:15:48.496 15:16:52 -- target/connect_stress.sh@38 -- # wait 601684 00:15:48.496 15:16:52 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:15:48.496 15:16:52 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:48.496 15:16:52 -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:48.496 15:16:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:48.496 15:16:52 -- nvmf/common.sh@117 -- # sync 00:15:48.496 15:16:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:48.496 15:16:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:48.496 15:16:52 -- nvmf/common.sh@120 -- # set +e 00:15:48.496 15:16:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:48.496 15:16:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:48.496 rmmod nvme_rdma 00:15:48.496 rmmod nvme_fabrics 00:15:48.496 15:16:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:48.496 15:16:52 -- nvmf/common.sh@124 -- # set -e 00:15:48.496 15:16:52 -- nvmf/common.sh@125 -- # return 0 00:15:48.496 15:16:52 -- nvmf/common.sh@478 -- # '[' -n 601569 ']' 00:15:48.496 15:16:52 -- nvmf/common.sh@479 -- # killprocess 601569 00:15:48.496 15:16:52 -- common/autotest_common.sh@936 -- # '[' -z 601569 ']' 00:15:48.496 15:16:52 -- common/autotest_common.sh@940 -- # kill -0 601569 00:15:48.496 15:16:52 -- common/autotest_common.sh@941 -- # uname 00:15:48.496 15:16:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:48.496 15:16:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 601569 00:15:48.496 15:16:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:48.496 15:16:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:48.496 15:16:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 601569' 00:15:48.496 killing process with pid 601569 00:15:48.496 15:16:52 -- common/autotest_common.sh@955 -- # kill 601569 00:15:48.496 15:16:52 -- common/autotest_common.sh@960 -- # wait 601569 00:15:48.496 [2024-04-24 15:16:52.329058] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:48.755 15:16:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:48.755 15:16:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:48.755 00:15:48.755 real 0m18.425s 00:15:48.755 user 0m41.246s 00:15:48.755 sys 0m9.907s 00:15:48.755 15:16:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:48.755 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:48.755 ************************************ 00:15:48.755 END TEST nvmf_connect_stress 00:15:48.755 ************************************ 00:15:48.755 15:16:52 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:15:48.755 15:16:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:48.755 15:16:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:48.755 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:49.015 ************************************ 00:15:49.015 START TEST nvmf_fused_ordering 00:15:49.015 ************************************ 00:15:49.015 15:16:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:15:49.015 * Looking for test storage... 00:15:49.015 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:15:49.015 15:16:52 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:15:49.015 15:16:52 -- nvmf/common.sh@7 -- # uname -s 00:15:49.015 15:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:49.015 15:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:49.015 15:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:49.015 15:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:49.015 15:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:49.015 15:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:49.015 15:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:49.015 15:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:49.015 15:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:49.015 15:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:49.015 15:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:15:49.015 15:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:15:49.015 15:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:49.015 15:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:49.015 15:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:49.015 15:16:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:49.015 15:16:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:15:49.015 15:16:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:49.015 15:16:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:49.015 15:16:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:49.015 15:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.015 15:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.015 15:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.015 15:16:52 -- paths/export.sh@5 -- # export PATH 00:15:49.015 15:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:49.015 15:16:52 -- nvmf/common.sh@47 -- # : 0 00:15:49.015 15:16:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:49.015 15:16:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:49.015 15:16:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:49.015 15:16:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:49.015 15:16:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:49.015 15:16:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:49.015 15:16:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:49.015 15:16:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:49.015 15:16:52 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:49.015 15:16:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:49.015 15:16:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:49.015 15:16:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:49.015 15:16:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:49.015 15:16:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:49.015 15:16:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:49.015 15:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:49.015 15:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.015 15:16:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:49.015 15:16:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:49.015 15:16:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:49.015 15:16:52 -- common/autotest_common.sh@10 -- # set +x 00:15:55.583 15:16:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:55.583 15:16:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:55.583 15:16:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:55.583 15:16:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:55.583 15:16:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:55.583 15:16:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:55.583 15:16:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:55.583 15:16:59 -- nvmf/common.sh@295 -- # net_devs=() 00:15:55.583 15:16:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:55.583 15:16:59 -- nvmf/common.sh@296 -- # e810=() 00:15:55.583 15:16:59 -- nvmf/common.sh@296 -- # local -ga e810 00:15:55.583 15:16:59 -- nvmf/common.sh@297 -- # x722=() 00:15:55.583 15:16:59 -- nvmf/common.sh@297 -- # local -ga x722 00:15:55.583 15:16:59 -- nvmf/common.sh@298 -- # mlx=() 00:15:55.583 15:16:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:55.583 15:16:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:55.583 15:16:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:55.583 15:16:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:55.583 15:16:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:55.583 15:16:59 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:15:55.583 15:16:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:55.583 15:16:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:55.583 15:16:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:15:55.583 Found 0000:18:00.0 (0x8086 - 0x1592) 00:15:55.583 15:16:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:55.583 15:16:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:55.583 15:16:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:15:55.583 Found 0000:18:00.1 (0x8086 - 0x1592) 00:15:55.583 15:16:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:55.583 15:16:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:55.583 15:16:59 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:15:55.583 15:16:59 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:15:55.583 15:16:59 -- nvmf/common.sh@377 -- # modinfo irdma 00:15:55.583 15:16:59 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:15:55.583 15:16:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:55.583 15:16:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.583 15:16:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:55.583 15:16:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.583 15:16:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:15:55.583 Found net devices under 0000:18:00.0: cvl_0_0 00:15:55.583 15:16:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.583 15:16:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:55.583 15:16:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.583 15:16:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:55.583 15:16:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.583 15:16:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:15:55.583 Found net devices under 0000:18:00.1: cvl_0_1 00:15:55.843 15:16:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.843 15:16:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:55.843 15:16:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:55.843 15:16:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:55.843 15:16:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:55.843 15:16:59 -- nvmf/common.sh@58 -- # uname 00:15:55.843 15:16:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:55.843 15:16:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:55.843 15:16:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:55.843 15:16:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:55.843 15:16:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:55.843 15:16:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:55.843 15:16:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:55.843 15:16:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:55.843 15:16:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:55.843 15:16:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:55.843 15:16:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:55.843 15:16:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:55.843 15:16:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:55.843 15:16:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:55.843 15:16:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:55.843 15:16:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:55.843 15:16:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:55.843 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.843 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.843 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:55.843 15:16:59 -- nvmf/common.sh@105 -- # continue 2 00:15:55.843 15:16:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:55.843 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.843 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:55.843 15:16:59 -- nvmf/common.sh@105 -- # continue 2 00:15:55.843 15:16:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:55.843 15:16:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:15:55.843 15:16:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:55.843 15:16:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:55.843 15:16:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:15:55.843 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:55.843 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:15:55.843 altname enp24s0f0np0 00:15:55.843 altname ens785f0np0 00:15:55.843 inet 192.168.100.8/24 scope global cvl_0_0 00:15:55.843 valid_lft forever preferred_lft forever 00:15:55.843 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:15:55.843 valid_lft forever preferred_lft forever 00:15:55.843 15:16:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:55.843 15:16:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:15:55.843 15:16:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:55.843 15:16:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:55.843 15:16:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:55.843 15:16:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:55.843 15:16:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:15:55.843 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:15:55.843 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:15:55.843 altname enp24s0f1np1 00:15:55.843 altname ens785f1np1 00:15:55.843 inet 192.168.100.9/24 scope global cvl_0_1 00:15:55.843 valid_lft forever preferred_lft forever 00:15:55.843 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:15:55.843 valid_lft forever preferred_lft forever 00:15:55.843 15:16:59 -- nvmf/common.sh@411 -- # return 0 00:15:55.844 15:16:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:55.844 15:16:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:55.844 15:16:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:55.844 15:16:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:55.844 15:16:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:55.844 15:16:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:55.844 15:16:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:55.844 15:16:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:55.844 15:16:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:55.844 15:16:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:55.844 15:16:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:55.844 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.844 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:15:55.844 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.844 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:15:55.844 15:16:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:15:55.844 15:16:59 -- nvmf/common.sh@105 -- # continue 2 00:15:55.844 15:16:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:55.844 15:16:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:55.844 15:16:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:15:55.844 15:16:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:15:55.844 15:16:59 -- nvmf/common.sh@105 -- # continue 2 00:15:55.844 15:16:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:55.844 15:16:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:15:55.844 15:16:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:55.844 15:16:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:55.844 15:16:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:15:55.844 15:16:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:15:55.844 15:16:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:55.844 15:16:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:55.844 192.168.100.9' 00:15:55.844 15:16:59 -- nvmf/common.sh@446 -- # head -n 1 00:15:55.844 15:16:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:55.844 192.168.100.9' 00:15:55.844 15:16:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:55.844 15:16:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:55.844 192.168.100.9' 00:15:55.844 15:16:59 -- nvmf/common.sh@447 -- # tail -n +2 00:15:55.844 15:16:59 -- nvmf/common.sh@447 -- # head -n 1 00:15:55.844 15:16:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:55.844 15:16:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:55.844 15:16:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:55.844 15:16:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:55.844 15:16:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:55.844 15:16:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:55.844 15:16:59 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:55.844 15:16:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:55.844 15:16:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:55.844 15:16:59 -- common/autotest_common.sh@10 -- # set +x 00:15:55.844 15:16:59 -- nvmf/common.sh@470 -- # nvmfpid=606352 00:15:55.844 15:16:59 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:55.844 15:16:59 -- nvmf/common.sh@471 -- # waitforlisten 606352 00:15:55.844 15:16:59 -- common/autotest_common.sh@817 -- # '[' -z 606352 ']' 00:15:55.844 15:16:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:55.844 15:16:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:55.844 15:16:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:55.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:55.844 15:16:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:55.844 15:16:59 -- common/autotest_common.sh@10 -- # set +x 00:15:56.103 [2024-04-24 15:16:59.786067] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:15:56.103 [2024-04-24 15:16:59.786130] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:56.103 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.103 [2024-04-24 15:16:59.868686] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:56.103 [2024-04-24 15:16:59.952446] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:56.103 [2024-04-24 15:16:59.952506] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:56.103 [2024-04-24 15:16:59.952531] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:56.103 [2024-04-24 15:16:59.952539] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:56.103 [2024-04-24 15:16:59.952546] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:56.103 [2024-04-24 15:16:59.952571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:57.040 15:17:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:57.040 15:17:00 -- common/autotest_common.sh@850 -- # return 0 00:15:57.040 15:17:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:57.040 15:17:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:57.040 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.040 15:17:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:57.040 15:17:00 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:57.040 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.040 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.040 [2024-04-24 15:17:00.647611] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x163bb00/0x163b140) succeed. 00:15:57.040 [2024-04-24 15:17:00.656872] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x163cdb0/0x163b6c0) succeed. 00:15:57.040 [2024-04-24 15:17:00.656903] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:57.041 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.041 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:57.041 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.041 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.041 [2024-04-24 15:17:00.674334] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:57.041 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.041 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.041 NULL1 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:57.041 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.041 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:57.041 15:17:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:57.041 15:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:57.041 15:17:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:57.041 15:17:00 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:57.041 [2024-04-24 15:17:00.722609] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:15:57.041 [2024-04-24 15:17:00.722639] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid606422 ] 00:15:57.041 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.041 Attached to nqn.2016-06.io.spdk:cnode1 00:15:57.041 Namespace ID: 1 size: 1GB 00:15:57.041 fused_ordering(0) 00:15:57.041 fused_ordering(1) 00:15:57.041 fused_ordering(2) 00:15:57.041 fused_ordering(3) 00:15:57.041 fused_ordering(4) 00:15:57.041 fused_ordering(5) 00:15:57.041 fused_ordering(6) 00:15:57.041 fused_ordering(7) 00:15:57.041 fused_ordering(8) 00:15:57.041 fused_ordering(9) 00:15:57.041 fused_ordering(10) 00:15:57.041 fused_ordering(11) 00:15:57.041 fused_ordering(12) 00:15:57.041 fused_ordering(13) 00:15:57.041 fused_ordering(14) 00:15:57.041 fused_ordering(15) 00:15:57.041 fused_ordering(16) 00:15:57.041 fused_ordering(17) 00:15:57.041 fused_ordering(18) 00:15:57.041 fused_ordering(19) 00:15:57.041 fused_ordering(20) 00:15:57.041 fused_ordering(21) 00:15:57.041 fused_ordering(22) 00:15:57.041 fused_ordering(23) 00:15:57.041 fused_ordering(24) 00:15:57.041 fused_ordering(25) 00:15:57.041 fused_ordering(26) 00:15:57.041 fused_ordering(27) 00:15:57.041 fused_ordering(28) 00:15:57.041 fused_ordering(29) 00:15:57.041 fused_ordering(30) 00:15:57.041 fused_ordering(31) 00:15:57.041 fused_ordering(32) 00:15:57.041 fused_ordering(33) 00:15:57.041 fused_ordering(34) 00:15:57.041 fused_ordering(35) 00:15:57.041 fused_ordering(36) 00:15:57.041 fused_ordering(37) 00:15:57.041 fused_ordering(38) 00:15:57.041 fused_ordering(39) 00:15:57.041 fused_ordering(40) 00:15:57.041 fused_ordering(41) 00:15:57.041 fused_ordering(42) 00:15:57.041 fused_ordering(43) 00:15:57.041 fused_ordering(44) 00:15:57.041 fused_ordering(45) 00:15:57.041 fused_ordering(46) 00:15:57.041 fused_ordering(47) 00:15:57.041 fused_ordering(48) 00:15:57.041 fused_ordering(49) 00:15:57.041 fused_ordering(50) 00:15:57.041 fused_ordering(51) 00:15:57.041 fused_ordering(52) 00:15:57.041 fused_ordering(53) 00:15:57.041 fused_ordering(54) 00:15:57.041 fused_ordering(55) 00:15:57.041 fused_ordering(56) 00:15:57.041 fused_ordering(57) 00:15:57.041 fused_ordering(58) 00:15:57.041 fused_ordering(59) 00:15:57.041 fused_ordering(60) 00:15:57.041 fused_ordering(61) 00:15:57.041 fused_ordering(62) 00:15:57.041 fused_ordering(63) 00:15:57.041 fused_ordering(64) 00:15:57.041 fused_ordering(65) 00:15:57.041 fused_ordering(66) 00:15:57.041 fused_ordering(67) 00:15:57.041 fused_ordering(68) 00:15:57.041 fused_ordering(69) 00:15:57.041 fused_ordering(70) 00:15:57.041 fused_ordering(71) 00:15:57.041 fused_ordering(72) 00:15:57.041 fused_ordering(73) 00:15:57.041 fused_ordering(74) 00:15:57.041 fused_ordering(75) 00:15:57.041 fused_ordering(76) 00:15:57.041 fused_ordering(77) 00:15:57.041 fused_ordering(78) 00:15:57.041 fused_ordering(79) 00:15:57.041 fused_ordering(80) 00:15:57.041 fused_ordering(81) 00:15:57.041 fused_ordering(82) 00:15:57.041 fused_ordering(83) 00:15:57.041 fused_ordering(84) 00:15:57.041 fused_ordering(85) 00:15:57.041 fused_ordering(86) 00:15:57.041 fused_ordering(87) 00:15:57.041 fused_ordering(88) 00:15:57.041 fused_ordering(89) 00:15:57.041 fused_ordering(90) 00:15:57.041 fused_ordering(91) 00:15:57.041 fused_ordering(92) 00:15:57.041 fused_ordering(93) 00:15:57.041 fused_ordering(94) 00:15:57.041 fused_ordering(95) 00:15:57.041 fused_ordering(96) 00:15:57.041 fused_ordering(97) 00:15:57.041 fused_ordering(98) 00:15:57.041 fused_ordering(99) 00:15:57.041 fused_ordering(100) 00:15:57.041 fused_ordering(101) 00:15:57.041 fused_ordering(102) 00:15:57.041 fused_ordering(103) 00:15:57.041 fused_ordering(104) 00:15:57.041 fused_ordering(105) 00:15:57.041 fused_ordering(106) 00:15:57.041 fused_ordering(107) 00:15:57.041 fused_ordering(108) 00:15:57.041 fused_ordering(109) 00:15:57.041 fused_ordering(110) 00:15:57.041 fused_ordering(111) 00:15:57.041 fused_ordering(112) 00:15:57.041 fused_ordering(113) 00:15:57.041 fused_ordering(114) 00:15:57.041 fused_ordering(115) 00:15:57.041 fused_ordering(116) 00:15:57.041 fused_ordering(117) 00:15:57.041 fused_ordering(118) 00:15:57.041 fused_ordering(119) 00:15:57.041 fused_ordering(120) 00:15:57.041 fused_ordering(121) 00:15:57.041 fused_ordering(122) 00:15:57.041 fused_ordering(123) 00:15:57.041 fused_ordering(124) 00:15:57.041 fused_ordering(125) 00:15:57.041 fused_ordering(126) 00:15:57.041 fused_ordering(127) 00:15:57.041 fused_ordering(128) 00:15:57.041 fused_ordering(129) 00:15:57.041 fused_ordering(130) 00:15:57.041 fused_ordering(131) 00:15:57.041 fused_ordering(132) 00:15:57.041 fused_ordering(133) 00:15:57.041 fused_ordering(134) 00:15:57.041 fused_ordering(135) 00:15:57.041 fused_ordering(136) 00:15:57.041 fused_ordering(137) 00:15:57.041 fused_ordering(138) 00:15:57.041 fused_ordering(139) 00:15:57.041 fused_ordering(140) 00:15:57.041 fused_ordering(141) 00:15:57.041 fused_ordering(142) 00:15:57.041 fused_ordering(143) 00:15:57.041 fused_ordering(144) 00:15:57.041 fused_ordering(145) 00:15:57.041 fused_ordering(146) 00:15:57.041 fused_ordering(147) 00:15:57.041 fused_ordering(148) 00:15:57.041 fused_ordering(149) 00:15:57.041 fused_ordering(150) 00:15:57.041 fused_ordering(151) 00:15:57.041 fused_ordering(152) 00:15:57.041 fused_ordering(153) 00:15:57.041 fused_ordering(154) 00:15:57.041 fused_ordering(155) 00:15:57.041 fused_ordering(156) 00:15:57.041 fused_ordering(157) 00:15:57.041 fused_ordering(158) 00:15:57.041 fused_ordering(159) 00:15:57.041 fused_ordering(160) 00:15:57.041 fused_ordering(161) 00:15:57.041 fused_ordering(162) 00:15:57.041 fused_ordering(163) 00:15:57.041 fused_ordering(164) 00:15:57.041 fused_ordering(165) 00:15:57.041 fused_ordering(166) 00:15:57.041 fused_ordering(167) 00:15:57.041 fused_ordering(168) 00:15:57.041 fused_ordering(169) 00:15:57.041 fused_ordering(170) 00:15:57.041 fused_ordering(171) 00:15:57.041 fused_ordering(172) 00:15:57.041 fused_ordering(173) 00:15:57.041 fused_ordering(174) 00:15:57.041 fused_ordering(175) 00:15:57.041 fused_ordering(176) 00:15:57.041 fused_ordering(177) 00:15:57.041 fused_ordering(178) 00:15:57.041 fused_ordering(179) 00:15:57.041 fused_ordering(180) 00:15:57.041 fused_ordering(181) 00:15:57.041 fused_ordering(182) 00:15:57.041 fused_ordering(183) 00:15:57.041 fused_ordering(184) 00:15:57.041 fused_ordering(185) 00:15:57.041 fused_ordering(186) 00:15:57.041 fused_ordering(187) 00:15:57.041 fused_ordering(188) 00:15:57.041 fused_ordering(189) 00:15:57.041 fused_ordering(190) 00:15:57.041 fused_ordering(191) 00:15:57.041 fused_ordering(192) 00:15:57.041 fused_ordering(193) 00:15:57.041 fused_ordering(194) 00:15:57.041 fused_ordering(195) 00:15:57.041 fused_ordering(196) 00:15:57.041 fused_ordering(197) 00:15:57.041 fused_ordering(198) 00:15:57.041 fused_ordering(199) 00:15:57.041 fused_ordering(200) 00:15:57.041 fused_ordering(201) 00:15:57.041 fused_ordering(202) 00:15:57.041 fused_ordering(203) 00:15:57.041 fused_ordering(204) 00:15:57.041 fused_ordering(205) 00:15:57.301 fused_ordering(206) 00:15:57.301 fused_ordering(207) 00:15:57.301 fused_ordering(208) 00:15:57.301 fused_ordering(209) 00:15:57.301 fused_ordering(210) 00:15:57.301 fused_ordering(211) 00:15:57.301 fused_ordering(212) 00:15:57.301 fused_ordering(213) 00:15:57.301 fused_ordering(214) 00:15:57.301 fused_ordering(215) 00:15:57.301 fused_ordering(216) 00:15:57.301 fused_ordering(217) 00:15:57.301 fused_ordering(218) 00:15:57.301 fused_ordering(219) 00:15:57.301 fused_ordering(220) 00:15:57.301 fused_ordering(221) 00:15:57.301 fused_ordering(222) 00:15:57.301 fused_ordering(223) 00:15:57.301 fused_ordering(224) 00:15:57.301 fused_ordering(225) 00:15:57.301 fused_ordering(226) 00:15:57.301 fused_ordering(227) 00:15:57.301 fused_ordering(228) 00:15:57.301 fused_ordering(229) 00:15:57.301 fused_ordering(230) 00:15:57.301 fused_ordering(231) 00:15:57.301 fused_ordering(232) 00:15:57.301 fused_ordering(233) 00:15:57.301 fused_ordering(234) 00:15:57.301 fused_ordering(235) 00:15:57.301 fused_ordering(236) 00:15:57.301 fused_ordering(237) 00:15:57.301 fused_ordering(238) 00:15:57.301 fused_ordering(239) 00:15:57.301 fused_ordering(240) 00:15:57.301 fused_ordering(241) 00:15:57.301 fused_ordering(242) 00:15:57.301 fused_ordering(243) 00:15:57.301 fused_ordering(244) 00:15:57.301 fused_ordering(245) 00:15:57.301 fused_ordering(246) 00:15:57.301 fused_ordering(247) 00:15:57.301 fused_ordering(248) 00:15:57.301 fused_ordering(249) 00:15:57.301 fused_ordering(250) 00:15:57.301 fused_ordering(251) 00:15:57.301 fused_ordering(252) 00:15:57.301 fused_ordering(253) 00:15:57.301 fused_ordering(254) 00:15:57.301 fused_ordering(255) 00:15:57.301 fused_ordering(256) 00:15:57.301 fused_ordering(257) 00:15:57.301 fused_ordering(258) 00:15:57.301 fused_ordering(259) 00:15:57.301 fused_ordering(260) 00:15:57.301 fused_ordering(261) 00:15:57.301 fused_ordering(262) 00:15:57.301 fused_ordering(263) 00:15:57.301 fused_ordering(264) 00:15:57.301 fused_ordering(265) 00:15:57.301 fused_ordering(266) 00:15:57.301 fused_ordering(267) 00:15:57.301 fused_ordering(268) 00:15:57.301 fused_ordering(269) 00:15:57.301 fused_ordering(270) 00:15:57.301 fused_ordering(271) 00:15:57.301 fused_ordering(272) 00:15:57.301 fused_ordering(273) 00:15:57.301 fused_ordering(274) 00:15:57.301 fused_ordering(275) 00:15:57.301 fused_ordering(276) 00:15:57.301 fused_ordering(277) 00:15:57.301 fused_ordering(278) 00:15:57.301 fused_ordering(279) 00:15:57.301 fused_ordering(280) 00:15:57.301 fused_ordering(281) 00:15:57.301 fused_ordering(282) 00:15:57.301 fused_ordering(283) 00:15:57.301 fused_ordering(284) 00:15:57.302 fused_ordering(285) 00:15:57.302 fused_ordering(286) 00:15:57.302 fused_ordering(287) 00:15:57.302 fused_ordering(288) 00:15:57.302 fused_ordering(289) 00:15:57.302 fused_ordering(290) 00:15:57.302 fused_ordering(291) 00:15:57.302 fused_ordering(292) 00:15:57.302 fused_ordering(293) 00:15:57.302 fused_ordering(294) 00:15:57.302 fused_ordering(295) 00:15:57.302 fused_ordering(296) 00:15:57.302 fused_ordering(297) 00:15:57.302 fused_ordering(298) 00:15:57.302 fused_ordering(299) 00:15:57.302 fused_ordering(300) 00:15:57.302 fused_ordering(301) 00:15:57.302 fused_ordering(302) 00:15:57.302 fused_ordering(303) 00:15:57.302 fused_ordering(304) 00:15:57.302 fused_ordering(305) 00:15:57.302 fused_ordering(306) 00:15:57.302 fused_ordering(307) 00:15:57.302 fused_ordering(308) 00:15:57.302 fused_ordering(309) 00:15:57.302 fused_ordering(310) 00:15:57.302 fused_ordering(311) 00:15:57.302 fused_ordering(312) 00:15:57.302 fused_ordering(313) 00:15:57.302 fused_ordering(314) 00:15:57.302 fused_ordering(315) 00:15:57.302 fused_ordering(316) 00:15:57.302 fused_ordering(317) 00:15:57.302 fused_ordering(318) 00:15:57.302 fused_ordering(319) 00:15:57.302 fused_ordering(320) 00:15:57.302 fused_ordering(321) 00:15:57.302 fused_ordering(322) 00:15:57.302 fused_ordering(323) 00:15:57.302 fused_ordering(324) 00:15:57.302 fused_ordering(325) 00:15:57.302 fused_ordering(326) 00:15:57.302 fused_ordering(327) 00:15:57.302 fused_ordering(328) 00:15:57.302 fused_ordering(329) 00:15:57.302 fused_ordering(330) 00:15:57.302 fused_ordering(331) 00:15:57.302 fused_ordering(332) 00:15:57.302 fused_ordering(333) 00:15:57.302 fused_ordering(334) 00:15:57.302 fused_ordering(335) 00:15:57.302 fused_ordering(336) 00:15:57.302 fused_ordering(337) 00:15:57.302 fused_ordering(338) 00:15:57.302 fused_ordering(339) 00:15:57.302 fused_ordering(340) 00:15:57.302 fused_ordering(341) 00:15:57.302 fused_ordering(342) 00:15:57.302 fused_ordering(343) 00:15:57.302 fused_ordering(344) 00:15:57.302 fused_ordering(345) 00:15:57.302 fused_ordering(346) 00:15:57.302 fused_ordering(347) 00:15:57.302 fused_ordering(348) 00:15:57.302 fused_ordering(349) 00:15:57.302 fused_ordering(350) 00:15:57.302 fused_ordering(351) 00:15:57.302 fused_ordering(352) 00:15:57.302 fused_ordering(353) 00:15:57.302 fused_ordering(354) 00:15:57.302 fused_ordering(355) 00:15:57.302 fused_ordering(356) 00:15:57.302 fused_ordering(357) 00:15:57.302 fused_ordering(358) 00:15:57.302 fused_ordering(359) 00:15:57.302 fused_ordering(360) 00:15:57.302 fused_ordering(361) 00:15:57.302 fused_ordering(362) 00:15:57.302 fused_ordering(363) 00:15:57.302 fused_ordering(364) 00:15:57.302 fused_ordering(365) 00:15:57.302 fused_ordering(366) 00:15:57.302 fused_ordering(367) 00:15:57.302 fused_ordering(368) 00:15:57.302 fused_ordering(369) 00:15:57.302 fused_ordering(370) 00:15:57.302 fused_ordering(371) 00:15:57.302 fused_ordering(372) 00:15:57.302 fused_ordering(373) 00:15:57.302 fused_ordering(374) 00:15:57.302 fused_ordering(375) 00:15:57.302 fused_ordering(376) 00:15:57.302 fused_ordering(377) 00:15:57.302 fused_ordering(378) 00:15:57.302 fused_ordering(379) 00:15:57.302 fused_ordering(380) 00:15:57.302 fused_ordering(381) 00:15:57.302 fused_ordering(382) 00:15:57.302 fused_ordering(383) 00:15:57.302 fused_ordering(384) 00:15:57.302 fused_ordering(385) 00:15:57.302 fused_ordering(386) 00:15:57.302 fused_ordering(387) 00:15:57.302 fused_ordering(388) 00:15:57.302 fused_ordering(389) 00:15:57.302 fused_ordering(390) 00:15:57.302 fused_ordering(391) 00:15:57.302 fused_ordering(392) 00:15:57.302 fused_ordering(393) 00:15:57.302 fused_ordering(394) 00:15:57.302 fused_ordering(395) 00:15:57.302 fused_ordering(396) 00:15:57.302 fused_ordering(397) 00:15:57.302 fused_ordering(398) 00:15:57.302 fused_ordering(399) 00:15:57.302 fused_ordering(400) 00:15:57.302 fused_ordering(401) 00:15:57.302 fused_ordering(402) 00:15:57.302 fused_ordering(403) 00:15:57.302 fused_ordering(404) 00:15:57.302 fused_ordering(405) 00:15:57.302 fused_ordering(406) 00:15:57.302 fused_ordering(407) 00:15:57.302 fused_ordering(408) 00:15:57.302 fused_ordering(409) 00:15:57.302 fused_ordering(410) 00:15:57.302 fused_ordering(411) 00:15:57.302 fused_ordering(412) 00:15:57.302 fused_ordering(413) 00:15:57.302 fused_ordering(414) 00:15:57.302 fused_ordering(415) 00:15:57.302 fused_ordering(416) 00:15:57.302 fused_ordering(417) 00:15:57.302 fused_ordering(418) 00:15:57.302 fused_ordering(419) 00:15:57.302 fused_ordering(420) 00:15:57.302 fused_ordering(421) 00:15:57.302 fused_ordering(422) 00:15:57.302 fused_ordering(423) 00:15:57.302 fused_ordering(424) 00:15:57.302 fused_ordering(425) 00:15:57.302 fused_ordering(426) 00:15:57.302 fused_ordering(427) 00:15:57.302 fused_ordering(428) 00:15:57.302 fused_ordering(429) 00:15:57.302 fused_ordering(430) 00:15:57.302 fused_ordering(431) 00:15:57.302 fused_ordering(432) 00:15:57.302 fused_ordering(433) 00:15:57.302 fused_ordering(434) 00:15:57.302 fused_ordering(435) 00:15:57.302 fused_ordering(436) 00:15:57.302 fused_ordering(437) 00:15:57.302 fused_ordering(438) 00:15:57.302 fused_ordering(439) 00:15:57.302 fused_ordering(440) 00:15:57.302 fused_ordering(441) 00:15:57.302 fused_ordering(442) 00:15:57.302 fused_ordering(443) 00:15:57.302 fused_ordering(444) 00:15:57.302 fused_ordering(445) 00:15:57.302 fused_ordering(446) 00:15:57.302 fused_ordering(447) 00:15:57.302 fused_ordering(448) 00:15:57.302 fused_ordering(449) 00:15:57.302 fused_ordering(450) 00:15:57.302 fused_ordering(451) 00:15:57.302 fused_ordering(452) 00:15:57.302 fused_ordering(453) 00:15:57.302 fused_ordering(454) 00:15:57.302 fused_ordering(455) 00:15:57.302 fused_ordering(456) 00:15:57.302 fused_ordering(457) 00:15:57.302 fused_ordering(458) 00:15:57.302 fused_ordering(459) 00:15:57.302 fused_ordering(460) 00:15:57.302 fused_ordering(461) 00:15:57.302 fused_ordering(462) 00:15:57.302 fused_ordering(463) 00:15:57.302 fused_ordering(464) 00:15:57.302 fused_ordering(465) 00:15:57.302 fused_ordering(466) 00:15:57.302 fused_ordering(467) 00:15:57.302 fused_ordering(468) 00:15:57.302 fused_ordering(469) 00:15:57.302 fused_ordering(470) 00:15:57.302 fused_ordering(471) 00:15:57.302 fused_ordering(472) 00:15:57.302 fused_ordering(473) 00:15:57.302 fused_ordering(474) 00:15:57.302 fused_ordering(475) 00:15:57.302 fused_ordering(476) 00:15:57.302 fused_ordering(477) 00:15:57.302 fused_ordering(478) 00:15:57.302 fused_ordering(479) 00:15:57.302 fused_ordering(480) 00:15:57.302 fused_ordering(481) 00:15:57.302 fused_ordering(482) 00:15:57.302 fused_ordering(483) 00:15:57.302 fused_ordering(484) 00:15:57.302 fused_ordering(485) 00:15:57.302 fused_ordering(486) 00:15:57.302 fused_ordering(487) 00:15:57.302 fused_ordering(488) 00:15:57.302 fused_ordering(489) 00:15:57.302 fused_ordering(490) 00:15:57.302 fused_ordering(491) 00:15:57.302 fused_ordering(492) 00:15:57.302 fused_ordering(493) 00:15:57.302 fused_ordering(494) 00:15:57.302 fused_ordering(495) 00:15:57.302 fused_ordering(496) 00:15:57.302 fused_ordering(497) 00:15:57.302 fused_ordering(498) 00:15:57.302 fused_ordering(499) 00:15:57.302 fused_ordering(500) 00:15:57.302 fused_ordering(501) 00:15:57.302 fused_ordering(502) 00:15:57.302 fused_ordering(503) 00:15:57.302 fused_ordering(504) 00:15:57.302 fused_ordering(505) 00:15:57.302 fused_ordering(506) 00:15:57.302 fused_ordering(507) 00:15:57.302 fused_ordering(508) 00:15:57.302 fused_ordering(509) 00:15:57.302 fused_ordering(510) 00:15:57.302 fused_ordering(511) 00:15:57.302 fused_ordering(512) 00:15:57.302 fused_ordering(513) 00:15:57.302 fused_ordering(514) 00:15:57.302 fused_ordering(515) 00:15:57.302 fused_ordering(516) 00:15:57.302 fused_ordering(517) 00:15:57.302 fused_ordering(518) 00:15:57.302 fused_ordering(519) 00:15:57.302 fused_ordering(520) 00:15:57.302 fused_ordering(521) 00:15:57.302 fused_ordering(522) 00:15:57.302 fused_ordering(523) 00:15:57.302 fused_ordering(524) 00:15:57.302 fused_ordering(525) 00:15:57.302 fused_ordering(526) 00:15:57.302 fused_ordering(527) 00:15:57.302 fused_ordering(528) 00:15:57.302 fused_ordering(529) 00:15:57.302 fused_ordering(530) 00:15:57.302 fused_ordering(531) 00:15:57.302 fused_ordering(532) 00:15:57.302 fused_ordering(533) 00:15:57.302 fused_ordering(534) 00:15:57.302 fused_ordering(535) 00:15:57.302 fused_ordering(536) 00:15:57.302 fused_ordering(537) 00:15:57.302 fused_ordering(538) 00:15:57.302 fused_ordering(539) 00:15:57.302 fused_ordering(540) 00:15:57.302 fused_ordering(541) 00:15:57.302 fused_ordering(542) 00:15:57.302 fused_ordering(543) 00:15:57.302 fused_ordering(544) 00:15:57.302 fused_ordering(545) 00:15:57.302 fused_ordering(546) 00:15:57.302 fused_ordering(547) 00:15:57.302 fused_ordering(548) 00:15:57.302 fused_ordering(549) 00:15:57.302 fused_ordering(550) 00:15:57.302 fused_ordering(551) 00:15:57.302 fused_ordering(552) 00:15:57.302 fused_ordering(553) 00:15:57.302 fused_ordering(554) 00:15:57.302 fused_ordering(555) 00:15:57.302 fused_ordering(556) 00:15:57.302 fused_ordering(557) 00:15:57.302 fused_ordering(558) 00:15:57.302 fused_ordering(559) 00:15:57.302 fused_ordering(560) 00:15:57.303 fused_ordering(561) 00:15:57.303 fused_ordering(562) 00:15:57.303 fused_ordering(563) 00:15:57.303 fused_ordering(564) 00:15:57.303 fused_ordering(565) 00:15:57.303 fused_ordering(566) 00:15:57.303 fused_ordering(567) 00:15:57.303 fused_ordering(568) 00:15:57.303 fused_ordering(569) 00:15:57.303 fused_ordering(570) 00:15:57.303 fused_ordering(571) 00:15:57.303 fused_ordering(572) 00:15:57.303 fused_ordering(573) 00:15:57.303 fused_ordering(574) 00:15:57.303 fused_ordering(575) 00:15:57.303 fused_ordering(576) 00:15:57.303 fused_ordering(577) 00:15:57.303 fused_ordering(578) 00:15:57.303 fused_ordering(579) 00:15:57.303 fused_ordering(580) 00:15:57.303 fused_ordering(581) 00:15:57.303 fused_ordering(582) 00:15:57.303 fused_ordering(583) 00:15:57.303 fused_ordering(584) 00:15:57.303 fused_ordering(585) 00:15:57.303 fused_ordering(586) 00:15:57.303 fused_ordering(587) 00:15:57.303 fused_ordering(588) 00:15:57.303 fused_ordering(589) 00:15:57.303 fused_ordering(590) 00:15:57.303 fused_ordering(591) 00:15:57.303 fused_ordering(592) 00:15:57.303 fused_ordering(593) 00:15:57.303 fused_ordering(594) 00:15:57.303 fused_ordering(595) 00:15:57.303 fused_ordering(596) 00:15:57.303 fused_ordering(597) 00:15:57.303 fused_ordering(598) 00:15:57.303 fused_ordering(599) 00:15:57.303 fused_ordering(600) 00:15:57.303 fused_ordering(601) 00:15:57.303 fused_ordering(602) 00:15:57.303 fused_ordering(603) 00:15:57.303 fused_ordering(604) 00:15:57.303 fused_ordering(605) 00:15:57.303 fused_ordering(606) 00:15:57.303 fused_ordering(607) 00:15:57.303 fused_ordering(608) 00:15:57.303 fused_ordering(609) 00:15:57.303 fused_ordering(610) 00:15:57.303 fused_ordering(611) 00:15:57.303 fused_ordering(612) 00:15:57.303 fused_ordering(613) 00:15:57.303 fused_ordering(614) 00:15:57.303 fused_ordering(615) 00:15:57.303 fused_ordering(616) 00:15:57.303 fused_ordering(617) 00:15:57.303 fused_ordering(618) 00:15:57.303 fused_ordering(619) 00:15:57.303 fused_ordering(620) 00:15:57.303 fused_ordering(621) 00:15:57.303 fused_ordering(622) 00:15:57.303 fused_ordering(623) 00:15:57.303 fused_ordering(624) 00:15:57.303 fused_ordering(625) 00:15:57.303 fused_ordering(626) 00:15:57.303 fused_ordering(627) 00:15:57.303 fused_ordering(628) 00:15:57.303 fused_ordering(629) 00:15:57.303 fused_ordering(630) 00:15:57.303 fused_ordering(631) 00:15:57.303 fused_ordering(632) 00:15:57.303 fused_ordering(633) 00:15:57.303 fused_ordering(634) 00:15:57.303 fused_ordering(635) 00:15:57.303 fused_ordering(636) 00:15:57.303 fused_ordering(637) 00:15:57.303 fused_ordering(638) 00:15:57.303 fused_ordering(639) 00:15:57.303 fused_ordering(640) 00:15:57.303 fused_ordering(641) 00:15:57.303 fused_ordering(642) 00:15:57.303 fused_ordering(643) 00:15:57.303 fused_ordering(644) 00:15:57.303 fused_ordering(645) 00:15:57.303 fused_ordering(646) 00:15:57.303 fused_ordering(647) 00:15:57.303 fused_ordering(648) 00:15:57.303 fused_ordering(649) 00:15:57.303 fused_ordering(650) 00:15:57.303 fused_ordering(651) 00:15:57.303 fused_ordering(652) 00:15:57.303 fused_ordering(653) 00:15:57.303 fused_ordering(654) 00:15:57.303 fused_ordering(655) 00:15:57.303 fused_ordering(656) 00:15:57.303 fused_ordering(657) 00:15:57.303 fused_ordering(658) 00:15:57.303 fused_ordering(659) 00:15:57.303 fused_ordering(660) 00:15:57.303 fused_ordering(661) 00:15:57.303 fused_ordering(662) 00:15:57.303 fused_ordering(663) 00:15:57.303 fused_ordering(664) 00:15:57.303 fused_ordering(665) 00:15:57.303 fused_ordering(666) 00:15:57.303 fused_ordering(667) 00:15:57.303 fused_ordering(668) 00:15:57.303 fused_ordering(669) 00:15:57.303 fused_ordering(670) 00:15:57.303 fused_ordering(671) 00:15:57.303 fused_ordering(672) 00:15:57.303 fused_ordering(673) 00:15:57.303 fused_ordering(674) 00:15:57.303 fused_ordering(675) 00:15:57.303 fused_ordering(676) 00:15:57.303 fused_ordering(677) 00:15:57.303 fused_ordering(678) 00:15:57.303 fused_ordering(679) 00:15:57.303 fused_ordering(680) 00:15:57.303 fused_ordering(681) 00:15:57.303 fused_ordering(682) 00:15:57.303 fused_ordering(683) 00:15:57.303 fused_ordering(684) 00:15:57.303 fused_ordering(685) 00:15:57.303 fused_ordering(686) 00:15:57.303 fused_ordering(687) 00:15:57.303 fused_ordering(688) 00:15:57.303 fused_ordering(689) 00:15:57.303 fused_ordering(690) 00:15:57.303 fused_ordering(691) 00:15:57.303 fused_ordering(692) 00:15:57.303 fused_ordering(693) 00:15:57.303 fused_ordering(694) 00:15:57.303 fused_ordering(695) 00:15:57.303 fused_ordering(696) 00:15:57.303 fused_ordering(697) 00:15:57.303 fused_ordering(698) 00:15:57.303 fused_ordering(699) 00:15:57.303 fused_ordering(700) 00:15:57.303 fused_ordering(701) 00:15:57.303 fused_ordering(702) 00:15:57.303 fused_ordering(703) 00:15:57.303 fused_ordering(704) 00:15:57.303 fused_ordering(705) 00:15:57.303 fused_ordering(706) 00:15:57.303 fused_ordering(707) 00:15:57.303 fused_ordering(708) 00:15:57.303 fused_ordering(709) 00:15:57.303 fused_ordering(710) 00:15:57.303 fused_ordering(711) 00:15:57.303 fused_ordering(712) 00:15:57.303 fused_ordering(713) 00:15:57.303 fused_ordering(714) 00:15:57.303 fused_ordering(715) 00:15:57.303 fused_ordering(716) 00:15:57.303 fused_ordering(717) 00:15:57.303 fused_ordering(718) 00:15:57.303 fused_ordering(719) 00:15:57.303 fused_ordering(720) 00:15:57.303 fused_ordering(721) 00:15:57.303 fused_ordering(722) 00:15:57.303 fused_ordering(723) 00:15:57.303 fused_ordering(724) 00:15:57.303 fused_ordering(725) 00:15:57.303 fused_ordering(726) 00:15:57.303 fused_ordering(727) 00:15:57.303 fused_ordering(728) 00:15:57.303 fused_ordering(729) 00:15:57.303 fused_ordering(730) 00:15:57.303 fused_ordering(731) 00:15:57.303 fused_ordering(732) 00:15:57.303 fused_ordering(733) 00:15:57.303 fused_ordering(734) 00:15:57.303 fused_ordering(735) 00:15:57.303 fused_ordering(736) 00:15:57.303 fused_ordering(737) 00:15:57.303 fused_ordering(738) 00:15:57.303 fused_ordering(739) 00:15:57.303 fused_ordering(740) 00:15:57.303 fused_ordering(741) 00:15:57.303 fused_ordering(742) 00:15:57.303 fused_ordering(743) 00:15:57.303 fused_ordering(744) 00:15:57.303 fused_ordering(745) 00:15:57.303 fused_ordering(746) 00:15:57.303 fused_ordering(747) 00:15:57.303 fused_ordering(748) 00:15:57.303 fused_ordering(749) 00:15:57.303 fused_ordering(750) 00:15:57.303 fused_ordering(751) 00:15:57.303 fused_ordering(752) 00:15:57.303 fused_ordering(753) 00:15:57.303 fused_ordering(754) 00:15:57.303 fused_ordering(755) 00:15:57.303 fused_ordering(756) 00:15:57.303 fused_ordering(757) 00:15:57.303 fused_ordering(758) 00:15:57.303 fused_ordering(759) 00:15:57.303 fused_ordering(760) 00:15:57.303 fused_ordering(761) 00:15:57.303 fused_ordering(762) 00:15:57.303 fused_ordering(763) 00:15:57.303 fused_ordering(764) 00:15:57.303 fused_ordering(765) 00:15:57.303 fused_ordering(766) 00:15:57.303 fused_ordering(767) 00:15:57.303 fused_ordering(768) 00:15:57.303 fused_ordering(769) 00:15:57.303 fused_ordering(770) 00:15:57.303 fused_ordering(771) 00:15:57.303 fused_ordering(772) 00:15:57.303 fused_ordering(773) 00:15:57.303 fused_ordering(774) 00:15:57.303 fused_ordering(775) 00:15:57.303 fused_ordering(776) 00:15:57.303 fused_ordering(777) 00:15:57.303 fused_ordering(778) 00:15:57.303 fused_ordering(779) 00:15:57.303 fused_ordering(780) 00:15:57.303 fused_ordering(781) 00:15:57.303 fused_ordering(782) 00:15:57.303 fused_ordering(783) 00:15:57.303 fused_ordering(784) 00:15:57.303 fused_ordering(785) 00:15:57.303 fused_ordering(786) 00:15:57.303 fused_ordering(787) 00:15:57.303 fused_ordering(788) 00:15:57.303 fused_ordering(789) 00:15:57.303 fused_ordering(790) 00:15:57.303 fused_ordering(791) 00:15:57.303 fused_ordering(792) 00:15:57.303 fused_ordering(793) 00:15:57.303 fused_ordering(794) 00:15:57.303 fused_ordering(795) 00:15:57.303 fused_ordering(796) 00:15:57.303 fused_ordering(797) 00:15:57.303 fused_ordering(798) 00:15:57.303 fused_ordering(799) 00:15:57.303 fused_ordering(800) 00:15:57.303 fused_ordering(801) 00:15:57.303 fused_ordering(802) 00:15:57.303 fused_ordering(803) 00:15:57.303 fused_ordering(804) 00:15:57.303 fused_ordering(805) 00:15:57.303 fused_ordering(806) 00:15:57.303 fused_ordering(807) 00:15:57.303 fused_ordering(808) 00:15:57.303 fused_ordering(809) 00:15:57.303 fused_ordering(810) 00:15:57.303 fused_ordering(811) 00:15:57.303 fused_ordering(812) 00:15:57.303 fused_ordering(813) 00:15:57.303 fused_ordering(814) 00:15:57.303 fused_ordering(815) 00:15:57.303 fused_ordering(816) 00:15:57.303 fused_ordering(817) 00:15:57.303 fused_ordering(818) 00:15:57.303 fused_ordering(819) 00:15:57.303 fused_ordering(820) 00:15:57.563 fused_ordering(821) 00:15:57.563 fused_ordering(822) 00:15:57.563 fused_ordering(823) 00:15:57.563 fused_ordering(824) 00:15:57.563 fused_ordering(825) 00:15:57.563 fused_ordering(826) 00:15:57.563 fused_ordering(827) 00:15:57.563 fused_ordering(828) 00:15:57.563 fused_ordering(829) 00:15:57.563 fused_ordering(830) 00:15:57.563 fused_ordering(831) 00:15:57.563 fused_ordering(832) 00:15:57.563 fused_ordering(833) 00:15:57.563 fused_ordering(834) 00:15:57.563 fused_ordering(835) 00:15:57.563 fused_ordering(836) 00:15:57.563 fused_ordering(837) 00:15:57.563 fused_ordering(838) 00:15:57.563 fused_ordering(839) 00:15:57.563 fused_ordering(840) 00:15:57.563 fused_ordering(841) 00:15:57.563 fused_ordering(842) 00:15:57.563 fused_ordering(843) 00:15:57.563 fused_ordering(844) 00:15:57.563 fused_ordering(845) 00:15:57.563 fused_ordering(846) 00:15:57.563 fused_ordering(847) 00:15:57.563 fused_ordering(848) 00:15:57.563 fused_ordering(849) 00:15:57.563 fused_ordering(850) 00:15:57.563 fused_ordering(851) 00:15:57.563 fused_ordering(852) 00:15:57.563 fused_ordering(853) 00:15:57.563 fused_ordering(854) 00:15:57.563 fused_ordering(855) 00:15:57.563 fused_ordering(856) 00:15:57.563 fused_ordering(857) 00:15:57.563 fused_ordering(858) 00:15:57.563 fused_ordering(859) 00:15:57.563 fused_ordering(860) 00:15:57.563 fused_ordering(861) 00:15:57.563 fused_ordering(862) 00:15:57.563 fused_ordering(863) 00:15:57.563 fused_ordering(864) 00:15:57.563 fused_ordering(865) 00:15:57.563 fused_ordering(866) 00:15:57.563 fused_ordering(867) 00:15:57.563 fused_ordering(868) 00:15:57.563 fused_ordering(869) 00:15:57.563 fused_ordering(870) 00:15:57.563 fused_ordering(871) 00:15:57.563 fused_ordering(872) 00:15:57.563 fused_ordering(873) 00:15:57.563 fused_ordering(874) 00:15:57.563 fused_ordering(875) 00:15:57.563 fused_ordering(876) 00:15:57.563 fused_ordering(877) 00:15:57.563 fused_ordering(878) 00:15:57.563 fused_ordering(879) 00:15:57.563 fused_ordering(880) 00:15:57.563 fused_ordering(881) 00:15:57.563 fused_ordering(882) 00:15:57.563 fused_ordering(883) 00:15:57.563 fused_ordering(884) 00:15:57.563 fused_ordering(885) 00:15:57.563 fused_ordering(886) 00:15:57.563 fused_ordering(887) 00:15:57.563 fused_ordering(888) 00:15:57.563 fused_ordering(889) 00:15:57.563 fused_ordering(890) 00:15:57.563 fused_ordering(891) 00:15:57.563 fused_ordering(892) 00:15:57.563 fused_ordering(893) 00:15:57.563 fused_ordering(894) 00:15:57.563 fused_ordering(895) 00:15:57.563 fused_ordering(896) 00:15:57.563 fused_ordering(897) 00:15:57.563 fused_ordering(898) 00:15:57.563 fused_ordering(899) 00:15:57.563 fused_ordering(900) 00:15:57.563 fused_ordering(901) 00:15:57.563 fused_ordering(902) 00:15:57.563 fused_ordering(903) 00:15:57.563 fused_ordering(904) 00:15:57.563 fused_ordering(905) 00:15:57.563 fused_ordering(906) 00:15:57.563 fused_ordering(907) 00:15:57.563 fused_ordering(908) 00:15:57.563 fused_ordering(909) 00:15:57.563 fused_ordering(910) 00:15:57.563 fused_ordering(911) 00:15:57.563 fused_ordering(912) 00:15:57.563 fused_ordering(913) 00:15:57.563 fused_ordering(914) 00:15:57.563 fused_ordering(915) 00:15:57.563 fused_ordering(916) 00:15:57.563 fused_ordering(917) 00:15:57.563 fused_ordering(918) 00:15:57.563 fused_ordering(919) 00:15:57.563 fused_ordering(920) 00:15:57.563 fused_ordering(921) 00:15:57.563 fused_ordering(922) 00:15:57.563 fused_ordering(923) 00:15:57.563 fused_ordering(924) 00:15:57.563 fused_ordering(925) 00:15:57.563 fused_ordering(926) 00:15:57.563 fused_ordering(927) 00:15:57.563 fused_ordering(928) 00:15:57.563 fused_ordering(929) 00:15:57.563 fused_ordering(930) 00:15:57.563 fused_ordering(931) 00:15:57.563 fused_ordering(932) 00:15:57.563 fused_ordering(933) 00:15:57.563 fused_ordering(934) 00:15:57.563 fused_ordering(935) 00:15:57.563 fused_ordering(936) 00:15:57.563 fused_ordering(937) 00:15:57.563 fused_ordering(938) 00:15:57.563 fused_ordering(939) 00:15:57.563 fused_ordering(940) 00:15:57.563 fused_ordering(941) 00:15:57.563 fused_ordering(942) 00:15:57.563 fused_ordering(943) 00:15:57.563 fused_ordering(944) 00:15:57.563 fused_ordering(945) 00:15:57.563 fused_ordering(946) 00:15:57.563 fused_ordering(947) 00:15:57.563 fused_ordering(948) 00:15:57.563 fused_ordering(949) 00:15:57.563 fused_ordering(950) 00:15:57.563 fused_ordering(951) 00:15:57.563 fused_ordering(952) 00:15:57.563 fused_ordering(953) 00:15:57.563 fused_ordering(954) 00:15:57.563 fused_ordering(955) 00:15:57.563 fused_ordering(956) 00:15:57.563 fused_ordering(957) 00:15:57.563 fused_ordering(958) 00:15:57.563 fused_ordering(959) 00:15:57.563 fused_ordering(960) 00:15:57.563 fused_ordering(961) 00:15:57.563 fused_ordering(962) 00:15:57.563 fused_ordering(963) 00:15:57.563 fused_ordering(964) 00:15:57.563 fused_ordering(965) 00:15:57.563 fused_ordering(966) 00:15:57.563 fused_ordering(967) 00:15:57.563 fused_ordering(968) 00:15:57.563 fused_ordering(969) 00:15:57.563 fused_ordering(970) 00:15:57.563 fused_ordering(971) 00:15:57.563 fused_ordering(972) 00:15:57.563 fused_ordering(973) 00:15:57.563 fused_ordering(974) 00:15:57.563 fused_ordering(975) 00:15:57.563 fused_ordering(976) 00:15:57.563 fused_ordering(977) 00:15:57.563 fused_ordering(978) 00:15:57.563 fused_ordering(979) 00:15:57.563 fused_ordering(980) 00:15:57.563 fused_ordering(981) 00:15:57.563 fused_ordering(982) 00:15:57.563 fused_ordering(983) 00:15:57.563 fused_ordering(984) 00:15:57.563 fused_ordering(985) 00:15:57.563 fused_ordering(986) 00:15:57.563 fused_ordering(987) 00:15:57.563 fused_ordering(988) 00:15:57.563 fused_ordering(989) 00:15:57.563 fused_ordering(990) 00:15:57.563 fused_ordering(991) 00:15:57.563 fused_ordering(992) 00:15:57.563 fused_ordering(993) 00:15:57.563 fused_ordering(994) 00:15:57.563 fused_ordering(995) 00:15:57.563 fused_ordering(996) 00:15:57.563 fused_ordering(997) 00:15:57.563 fused_ordering(998) 00:15:57.563 fused_ordering(999) 00:15:57.563 fused_ordering(1000) 00:15:57.563 fused_ordering(1001) 00:15:57.563 fused_ordering(1002) 00:15:57.563 fused_ordering(1003) 00:15:57.563 fused_ordering(1004) 00:15:57.563 fused_ordering(1005) 00:15:57.563 fused_ordering(1006) 00:15:57.563 fused_ordering(1007) 00:15:57.563 fused_ordering(1008) 00:15:57.563 fused_ordering(1009) 00:15:57.563 fused_ordering(1010) 00:15:57.563 fused_ordering(1011) 00:15:57.563 fused_ordering(1012) 00:15:57.563 fused_ordering(1013) 00:15:57.563 fused_ordering(1014) 00:15:57.563 fused_ordering(1015) 00:15:57.563 fused_ordering(1016) 00:15:57.563 fused_ordering(1017) 00:15:57.563 fused_ordering(1018) 00:15:57.563 fused_ordering(1019) 00:15:57.563 fused_ordering(1020) 00:15:57.563 fused_ordering(1021) 00:15:57.563 fused_ordering(1022) 00:15:57.563 fused_ordering(1023) 00:15:57.563 15:17:01 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:57.563 15:17:01 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:57.563 15:17:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:57.563 15:17:01 -- nvmf/common.sh@117 -- # sync 00:15:57.563 15:17:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:57.563 15:17:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:57.563 15:17:01 -- nvmf/common.sh@120 -- # set +e 00:15:57.563 15:17:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:57.563 15:17:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:57.563 rmmod nvme_rdma 00:15:57.563 rmmod nvme_fabrics 00:15:57.563 15:17:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:57.563 15:17:01 -- nvmf/common.sh@124 -- # set -e 00:15:57.563 15:17:01 -- nvmf/common.sh@125 -- # return 0 00:15:57.563 15:17:01 -- nvmf/common.sh@478 -- # '[' -n 606352 ']' 00:15:57.563 15:17:01 -- nvmf/common.sh@479 -- # killprocess 606352 00:15:57.563 15:17:01 -- common/autotest_common.sh@936 -- # '[' -z 606352 ']' 00:15:57.563 15:17:01 -- common/autotest_common.sh@940 -- # kill -0 606352 00:15:57.563 15:17:01 -- common/autotest_common.sh@941 -- # uname 00:15:57.564 15:17:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:57.564 15:17:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 606352 00:15:57.823 15:17:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:57.823 15:17:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:57.823 15:17:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 606352' 00:15:57.823 killing process with pid 606352 00:15:57.823 15:17:01 -- common/autotest_common.sh@955 -- # kill 606352 00:15:57.823 15:17:01 -- common/autotest_common.sh@960 -- # wait 606352 00:15:57.823 [2024-04-24 15:17:01.519388] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:58.082 15:17:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:58.082 15:17:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:58.082 00:15:58.082 real 0m8.973s 00:15:58.082 user 0m4.750s 00:15:58.082 sys 0m5.601s 00:15:58.082 15:17:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:58.082 15:17:01 -- common/autotest_common.sh@10 -- # set +x 00:15:58.082 ************************************ 00:15:58.082 END TEST nvmf_fused_ordering 00:15:58.082 ************************************ 00:15:58.082 15:17:01 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:15:58.082 15:17:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:58.082 15:17:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:58.082 15:17:01 -- common/autotest_common.sh@10 -- # set +x 00:15:58.082 ************************************ 00:15:58.082 START TEST nvmf_delete_subsystem 00:15:58.082 ************************************ 00:15:58.082 15:17:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:15:58.342 * Looking for test storage... 00:15:58.342 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:15:58.342 15:17:02 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:15:58.342 15:17:02 -- nvmf/common.sh@7 -- # uname -s 00:15:58.342 15:17:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:58.342 15:17:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:58.342 15:17:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:58.342 15:17:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:58.342 15:17:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:58.342 15:17:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:58.342 15:17:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:58.342 15:17:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:58.342 15:17:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:58.342 15:17:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:58.342 15:17:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:15:58.342 15:17:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:15:58.342 15:17:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:58.342 15:17:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:58.342 15:17:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:58.342 15:17:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:58.342 15:17:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:15:58.342 15:17:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:58.342 15:17:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:58.342 15:17:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:58.342 15:17:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.342 15:17:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.342 15:17:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.342 15:17:02 -- paths/export.sh@5 -- # export PATH 00:15:58.342 15:17:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:58.342 15:17:02 -- nvmf/common.sh@47 -- # : 0 00:15:58.342 15:17:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:58.342 15:17:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:58.342 15:17:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:58.342 15:17:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:58.342 15:17:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:58.342 15:17:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:58.342 15:17:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:58.342 15:17:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:58.342 15:17:02 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:58.342 15:17:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:58.342 15:17:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:58.342 15:17:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:58.342 15:17:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:58.342 15:17:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:58.342 15:17:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.342 15:17:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.342 15:17:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:58.342 15:17:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:58.342 15:17:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:58.342 15:17:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:58.342 15:17:02 -- common/autotest_common.sh@10 -- # set +x 00:16:04.910 15:17:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:04.910 15:17:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:04.910 15:17:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:04.910 15:17:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:04.910 15:17:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:04.910 15:17:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:04.910 15:17:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:04.910 15:17:08 -- nvmf/common.sh@295 -- # net_devs=() 00:16:04.910 15:17:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:04.910 15:17:08 -- nvmf/common.sh@296 -- # e810=() 00:16:04.910 15:17:08 -- nvmf/common.sh@296 -- # local -ga e810 00:16:04.910 15:17:08 -- nvmf/common.sh@297 -- # x722=() 00:16:04.910 15:17:08 -- nvmf/common.sh@297 -- # local -ga x722 00:16:04.910 15:17:08 -- nvmf/common.sh@298 -- # mlx=() 00:16:04.910 15:17:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:04.910 15:17:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:04.910 15:17:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:04.910 15:17:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:16:04.910 Found 0000:18:00.0 (0x8086 - 0x1592) 00:16:04.910 15:17:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:04.910 15:17:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:04.910 15:17:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:16:04.910 Found 0000:18:00.1 (0x8086 - 0x1592) 00:16:04.910 15:17:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:04.910 15:17:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:04.910 15:17:08 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:04.910 15:17:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:04.910 15:17:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.910 15:17:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.910 15:17:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:16:04.910 Found net devices under 0000:18:00.0: cvl_0_0 00:16:04.910 15:17:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:04.910 15:17:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.910 15:17:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.910 15:17:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:16:04.910 Found net devices under 0000:18:00.1: cvl_0_1 00:16:04.910 15:17:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.910 15:17:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:04.910 15:17:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:04.910 15:17:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:04.910 15:17:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:04.911 15:17:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:04.911 15:17:08 -- nvmf/common.sh@58 -- # uname 00:16:04.911 15:17:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:04.911 15:17:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:04.911 15:17:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:04.911 15:17:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:04.911 15:17:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:04.911 15:17:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:04.911 15:17:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:04.911 15:17:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:04.911 15:17:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:04.911 15:17:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:04.911 15:17:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:04.911 15:17:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:04.911 15:17:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:04.911 15:17:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:04.911 15:17:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:04.911 15:17:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:04.911 15:17:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@105 -- # continue 2 00:16:04.911 15:17:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@105 -- # continue 2 00:16:04.911 15:17:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:04.911 15:17:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:04.911 15:17:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:04.911 15:17:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:04.911 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:04.911 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:16:04.911 altname enp24s0f0np0 00:16:04.911 altname ens785f0np0 00:16:04.911 inet 192.168.100.8/24 scope global cvl_0_0 00:16:04.911 valid_lft forever preferred_lft forever 00:16:04.911 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:16:04.911 valid_lft forever preferred_lft forever 00:16:04.911 15:17:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:04.911 15:17:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:04.911 15:17:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:04.911 15:17:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:04.911 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:04.911 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:16:04.911 altname enp24s0f1np1 00:16:04.911 altname ens785f1np1 00:16:04.911 inet 192.168.100.9/24 scope global cvl_0_1 00:16:04.911 valid_lft forever preferred_lft forever 00:16:04.911 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:16:04.911 valid_lft forever preferred_lft forever 00:16:04.911 15:17:08 -- nvmf/common.sh@411 -- # return 0 00:16:04.911 15:17:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:04.911 15:17:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:04.911 15:17:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:04.911 15:17:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:04.911 15:17:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:04.911 15:17:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:04.911 15:17:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:04.911 15:17:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:04.911 15:17:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:04.911 15:17:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@105 -- # continue 2 00:16:04.911 15:17:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:04.911 15:17:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:04.911 15:17:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@105 -- # continue 2 00:16:04.911 15:17:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:04.911 15:17:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:04.911 15:17:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:04.911 15:17:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:04.911 15:17:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:04.911 15:17:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:04.911 192.168.100.9' 00:16:04.911 15:17:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:04.911 192.168.100.9' 00:16:04.911 15:17:08 -- nvmf/common.sh@446 -- # head -n 1 00:16:04.911 15:17:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:04.911 15:17:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:04.911 192.168.100.9' 00:16:04.911 15:17:08 -- nvmf/common.sh@447 -- # tail -n +2 00:16:04.911 15:17:08 -- nvmf/common.sh@447 -- # head -n 1 00:16:04.911 15:17:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:04.911 15:17:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:04.911 15:17:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:04.911 15:17:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:04.911 15:17:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:04.911 15:17:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:04.911 15:17:08 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:16:04.911 15:17:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:04.911 15:17:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:04.911 15:17:08 -- common/autotest_common.sh@10 -- # set +x 00:16:04.911 15:17:08 -- nvmf/common.sh@470 -- # nvmfpid=609789 00:16:04.911 15:17:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:04.911 15:17:08 -- nvmf/common.sh@471 -- # waitforlisten 609789 00:16:04.911 15:17:08 -- common/autotest_common.sh@817 -- # '[' -z 609789 ']' 00:16:04.911 15:17:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.911 15:17:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:04.911 15:17:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.911 15:17:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:04.911 15:17:08 -- common/autotest_common.sh@10 -- # set +x 00:16:04.911 [2024-04-24 15:17:08.659673] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:04.911 [2024-04-24 15:17:08.659733] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:04.911 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.911 [2024-04-24 15:17:08.739928] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:05.170 [2024-04-24 15:17:08.822512] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:05.170 [2024-04-24 15:17:08.822550] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:05.170 [2024-04-24 15:17:08.822560] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:05.170 [2024-04-24 15:17:08.822570] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:05.170 [2024-04-24 15:17:08.822577] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:05.170 [2024-04-24 15:17:08.822624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:05.170 [2024-04-24 15:17:08.822627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:05.739 15:17:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:05.739 15:17:09 -- common/autotest_common.sh@850 -- # return 0 00:16:05.739 15:17:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:05.739 15:17:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 15:17:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 [2024-04-24 15:17:09.533840] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x77a2e0/0x779920) succeed. 00:16:05.739 [2024-04-24 15:17:09.542808] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x77b590/0x779ea0) succeed. 00:16:05.739 [2024-04-24 15:17:09.542832] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 [2024-04-24 15:17:09.559038] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 NULL1 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 Delay0 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:05.739 15:17:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:05.739 15:17:09 -- common/autotest_common.sh@10 -- # set +x 00:16:05.739 15:17:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:05.739 15:17:09 -- target/delete_subsystem.sh@28 -- # perf_pid=609978 00:16:05.740 15:17:09 -- target/delete_subsystem.sh@30 -- # sleep 2 00:16:05.740 15:17:09 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:05.740 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.999 [2024-04-24 15:17:09.653105] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:07.903 15:17:11 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:07.903 15:17:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:07.903 15:17:11 -- common/autotest_common.sh@10 -- # set +x 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:08.840 NVMe io qpair process completion error 00:16:09.098 15:17:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.098 15:17:12 -- target/delete_subsystem.sh@34 -- # delay=0 00:16:09.098 15:17:12 -- target/delete_subsystem.sh@35 -- # kill -0 609978 00:16:09.098 15:17:12 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:09.359 15:17:13 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:09.359 15:17:13 -- target/delete_subsystem.sh@35 -- # kill -0 609978 00:16:09.359 15:17:13 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:09.359 [2024-04-24 15:17:13.268523] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Write completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.359 starting I/O failed: -6 00:16:09.359 [2024-04-24 15:17:13.268909] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.359 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 [2024-04-24 15:17:13.269093] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 [2024-04-24 15:17:13.269393] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 [2024-04-24 15:17:13.269742] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Write completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.360 Read completed with error (sct=0, sc=8) 00:16:09.360 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 starting I/O failed: -6 00:16:09.361 [2024-04-24 15:17:13.270229] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 [2024-04-24 15:17:13.270536] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 [2024-04-24 15:17:13.270706] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Write completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.361 Read completed with error (sct=0, sc=8) 00:16:09.620 [2024-04-24 15:17:13.271715] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:09.621 [2024-04-24 15:17:13.284325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:09.621 [2024-04-24 15:17:13.284345] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:09.621 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:16:09.621 Initializing NVMe Controllers 00:16:09.621 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:09.621 Controller IO queue size 128, less than required. 00:16:09.621 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:09.621 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:09.621 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:09.621 Initialization complete. Launching workers. 00:16:09.621 ======================================================== 00:16:09.621 Latency(us) 00:16:09.621 Device Information : IOPS MiB/s Average min max 00:16:09.621 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 90.58 0.04 1413609.93 1000237.06 2532299.27 00:16:09.621 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 90.58 0.04 1413119.13 1000856.65 2528835.18 00:16:09.621 ======================================================== 00:16:09.621 Total : 181.16 0.09 1413364.53 1000237.06 2532299.27 00:16:09.621 00:16:09.880 15:17:13 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:09.880 15:17:13 -- target/delete_subsystem.sh@35 -- # kill -0 609978 00:16:09.880 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (609978) - No such process 00:16:09.880 15:17:13 -- target/delete_subsystem.sh@45 -- # NOT wait 609978 00:16:09.880 15:17:13 -- common/autotest_common.sh@638 -- # local es=0 00:16:09.880 15:17:13 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 609978 00:16:09.880 15:17:13 -- common/autotest_common.sh@626 -- # local arg=wait 00:16:09.880 15:17:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:09.880 15:17:13 -- common/autotest_common.sh@630 -- # type -t wait 00:16:09.880 15:17:13 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:09.880 15:17:13 -- common/autotest_common.sh@641 -- # wait 609978 00:16:09.880 15:17:13 -- common/autotest_common.sh@641 -- # es=1 00:16:09.880 15:17:13 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:09.880 15:17:13 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:09.880 15:17:13 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:09.880 15:17:13 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:09.880 15:17:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.880 15:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:09.880 15:17:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:09.880 15:17:13 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:09.880 15:17:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:09.880 15:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:09.880 [2024-04-24 15:17:13.791851] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:10.140 15:17:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:10.140 15:17:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:10.140 15:17:13 -- common/autotest_common.sh@10 -- # set +x 00:16:10.140 15:17:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@54 -- # perf_pid=610512 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@56 -- # delay=0 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:10.140 15:17:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:10.140 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.140 [2024-04-24 15:17:13.877251] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:10.708 15:17:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:10.708 15:17:14 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:10.708 15:17:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:10.967 15:17:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:10.967 15:17:14 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:10.967 15:17:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:11.536 15:17:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:11.536 15:17:15 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:11.536 15:17:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:12.104 15:17:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:12.104 15:17:15 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:12.104 15:17:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:12.672 15:17:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:12.672 15:17:16 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:12.672 15:17:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:12.931 15:17:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:12.931 15:17:16 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:12.931 15:17:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:13.500 15:17:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:13.500 15:17:17 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:13.500 15:17:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:14.068 15:17:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:14.068 15:17:17 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:14.068 15:17:17 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:14.636 15:17:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:14.636 15:17:18 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:14.636 15:17:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:15.204 15:17:18 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:15.204 15:17:18 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:15.204 15:17:18 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:15.463 15:17:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:15.463 15:17:19 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:15.463 15:17:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:16.030 15:17:19 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:16.031 15:17:19 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:16.031 15:17:19 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:16.598 15:17:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:16.598 15:17:20 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:16.598 15:17:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:17.165 15:17:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:17.165 15:17:20 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:17.165 15:17:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:17.165 Initializing NVMe Controllers 00:16:17.165 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:17.165 Controller IO queue size 128, less than required. 00:16:17.165 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:17.165 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:17.165 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:17.165 Initialization complete. Launching workers. 00:16:17.165 ======================================================== 00:16:17.165 Latency(us) 00:16:17.165 Device Information : IOPS MiB/s Average min max 00:16:17.165 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1002736.10 1000130.43 1006094.30 00:16:17.165 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1001487.05 1000081.23 1003922.29 00:16:17.165 ======================================================== 00:16:17.165 Total : 256.00 0.12 1002111.57 1000081.23 1006094.30 00:16:17.165 00:16:17.734 15:17:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:17.734 15:17:21 -- target/delete_subsystem.sh@57 -- # kill -0 610512 00:16:17.734 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (610512) - No such process 00:16:17.734 15:17:21 -- target/delete_subsystem.sh@67 -- # wait 610512 00:16:17.734 15:17:21 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:16:17.734 15:17:21 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:16:17.734 15:17:21 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:17.734 15:17:21 -- nvmf/common.sh@117 -- # sync 00:16:17.734 15:17:21 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:17.734 15:17:21 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:17.734 15:17:21 -- nvmf/common.sh@120 -- # set +e 00:16:17.734 15:17:21 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:17.734 15:17:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:17.734 rmmod nvme_rdma 00:16:17.734 rmmod nvme_fabrics 00:16:17.734 15:17:21 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:17.734 15:17:21 -- nvmf/common.sh@124 -- # set -e 00:16:17.734 15:17:21 -- nvmf/common.sh@125 -- # return 0 00:16:17.734 15:17:21 -- nvmf/common.sh@478 -- # '[' -n 609789 ']' 00:16:17.734 15:17:21 -- nvmf/common.sh@479 -- # killprocess 609789 00:16:17.734 15:17:21 -- common/autotest_common.sh@936 -- # '[' -z 609789 ']' 00:16:17.734 15:17:21 -- common/autotest_common.sh@940 -- # kill -0 609789 00:16:17.734 15:17:21 -- common/autotest_common.sh@941 -- # uname 00:16:17.734 15:17:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:17.734 15:17:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 609789 00:16:17.735 15:17:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:17.735 15:17:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:17.735 15:17:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 609789' 00:16:17.735 killing process with pid 609789 00:16:17.735 15:17:21 -- common/autotest_common.sh@955 -- # kill 609789 00:16:17.735 15:17:21 -- common/autotest_common.sh@960 -- # wait 609789 00:16:17.735 [2024-04-24 15:17:21.511329] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:17.994 15:17:21 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:17.994 15:17:21 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:17.994 00:16:17.994 real 0m19.789s 00:16:17.994 user 0m48.464s 00:16:17.994 sys 0m6.011s 00:16:17.994 15:17:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:17.994 15:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:17.994 ************************************ 00:16:17.994 END TEST nvmf_delete_subsystem 00:16:17.994 ************************************ 00:16:17.994 15:17:21 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:16:17.994 15:17:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:17.994 15:17:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:17.994 15:17:21 -- common/autotest_common.sh@10 -- # set +x 00:16:18.253 ************************************ 00:16:18.253 START TEST nvmf_ns_masking 00:16:18.253 ************************************ 00:16:18.253 15:17:21 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:16:18.253 * Looking for test storage... 00:16:18.253 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:18.253 15:17:22 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:18.253 15:17:22 -- nvmf/common.sh@7 -- # uname -s 00:16:18.253 15:17:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:18.253 15:17:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:18.253 15:17:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:18.253 15:17:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:18.253 15:17:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:18.253 15:17:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:18.253 15:17:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:18.253 15:17:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:18.253 15:17:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:18.253 15:17:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:18.253 15:17:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:16:18.253 15:17:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:16:18.253 15:17:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:18.253 15:17:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:18.253 15:17:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:18.253 15:17:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:18.253 15:17:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:18.253 15:17:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:18.253 15:17:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:18.253 15:17:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:18.253 15:17:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.253 15:17:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.253 15:17:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.253 15:17:22 -- paths/export.sh@5 -- # export PATH 00:16:18.253 15:17:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.253 15:17:22 -- nvmf/common.sh@47 -- # : 0 00:16:18.253 15:17:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:18.253 15:17:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:18.253 15:17:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:18.253 15:17:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:18.253 15:17:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:18.253 15:17:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:18.253 15:17:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:18.253 15:17:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:18.253 15:17:22 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:18.253 15:17:22 -- target/ns_masking.sh@11 -- # loops=5 00:16:18.253 15:17:22 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:16:18.253 15:17:22 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:16:18.253 15:17:22 -- target/ns_masking.sh@15 -- # uuidgen 00:16:18.253 15:17:22 -- target/ns_masking.sh@15 -- # HOSTID=0beee5f9-8cad-47ab-b339-1ba51ac306e7 00:16:18.253 15:17:22 -- target/ns_masking.sh@44 -- # nvmftestinit 00:16:18.253 15:17:22 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:18.253 15:17:22 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:18.253 15:17:22 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:18.253 15:17:22 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:18.253 15:17:22 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:18.253 15:17:22 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:18.253 15:17:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:18.253 15:17:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:18.253 15:17:22 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:18.253 15:17:22 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:18.253 15:17:22 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:18.253 15:17:22 -- common/autotest_common.sh@10 -- # set +x 00:16:24.824 15:17:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:24.824 15:17:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:24.824 15:17:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:24.824 15:17:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:24.824 15:17:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:24.824 15:17:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:24.824 15:17:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:24.824 15:17:28 -- nvmf/common.sh@295 -- # net_devs=() 00:16:24.824 15:17:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:24.824 15:17:28 -- nvmf/common.sh@296 -- # e810=() 00:16:24.824 15:17:28 -- nvmf/common.sh@296 -- # local -ga e810 00:16:24.824 15:17:28 -- nvmf/common.sh@297 -- # x722=() 00:16:24.824 15:17:28 -- nvmf/common.sh@297 -- # local -ga x722 00:16:24.824 15:17:28 -- nvmf/common.sh@298 -- # mlx=() 00:16:24.824 15:17:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:24.824 15:17:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:24.824 15:17:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:24.824 15:17:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:24.824 15:17:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:16:24.824 Found 0000:18:00.0 (0x8086 - 0x1592) 00:16:24.824 15:17:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:24.824 15:17:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:24.824 15:17:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:16:24.824 Found 0000:18:00.1 (0x8086 - 0x1592) 00:16:24.824 15:17:28 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:24.824 15:17:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:24.824 15:17:28 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:24.824 15:17:28 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:24.824 15:17:28 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:24.824 15:17:28 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:24.824 15:17:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:24.824 15:17:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:24.824 15:17:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:24.824 15:17:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:24.824 15:17:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:16:24.824 Found net devices under 0000:18:00.0: cvl_0_0 00:16:24.824 15:17:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:24.824 15:17:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:24.824 15:17:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:24.824 15:17:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:24.824 15:17:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:16:24.824 Found net devices under 0000:18:00.1: cvl_0_1 00:16:24.824 15:17:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:24.824 15:17:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:24.825 15:17:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:24.825 15:17:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:24.825 15:17:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:24.825 15:17:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:24.825 15:17:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:25.085 15:17:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:25.085 15:17:28 -- nvmf/common.sh@58 -- # uname 00:16:25.085 15:17:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:25.085 15:17:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:25.085 15:17:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:25.085 15:17:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:25.085 15:17:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:25.085 15:17:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:25.085 15:17:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:25.085 15:17:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:25.085 15:17:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:25.085 15:17:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:25.085 15:17:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:25.085 15:17:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:25.085 15:17:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:25.085 15:17:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:25.085 15:17:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:25.085 15:17:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:25.085 15:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:25.085 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.085 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:25.085 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.085 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:25.085 15:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:25.086 15:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:25.086 15:17:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:25.086 15:17:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:25.086 15:17:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:25.086 15:17:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:25.086 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:25.086 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:16:25.086 altname enp24s0f0np0 00:16:25.086 altname ens785f0np0 00:16:25.086 inet 192.168.100.8/24 scope global cvl_0_0 00:16:25.086 valid_lft forever preferred_lft forever 00:16:25.086 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:16:25.086 valid_lft forever preferred_lft forever 00:16:25.086 15:17:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:25.086 15:17:28 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:25.086 15:17:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:25.086 15:17:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:25.086 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:25.086 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:16:25.086 altname enp24s0f1np1 00:16:25.086 altname ens785f1np1 00:16:25.086 inet 192.168.100.9/24 scope global cvl_0_1 00:16:25.086 valid_lft forever preferred_lft forever 00:16:25.086 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:16:25.086 valid_lft forever preferred_lft forever 00:16:25.086 15:17:28 -- nvmf/common.sh@411 -- # return 0 00:16:25.086 15:17:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:25.086 15:17:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:25.086 15:17:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:25.086 15:17:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:25.086 15:17:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:25.086 15:17:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:25.086 15:17:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:25.086 15:17:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:25.086 15:17:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:25.086 15:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:25.086 15:17:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:25.086 15:17:28 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:25.086 15:17:28 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@105 -- # continue 2 00:16:25.086 15:17:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:25.086 15:17:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:25.086 15:17:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:25.086 15:17:28 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:25.086 15:17:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:25.086 15:17:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:25.086 192.168.100.9' 00:16:25.086 15:17:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:25.086 192.168.100.9' 00:16:25.086 15:17:28 -- nvmf/common.sh@446 -- # head -n 1 00:16:25.086 15:17:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:25.086 15:17:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:25.086 192.168.100.9' 00:16:25.086 15:17:28 -- nvmf/common.sh@447 -- # tail -n +2 00:16:25.086 15:17:28 -- nvmf/common.sh@447 -- # head -n 1 00:16:25.086 15:17:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:25.086 15:17:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:25.086 15:17:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:25.086 15:17:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:25.086 15:17:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:25.086 15:17:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:25.086 15:17:28 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:16:25.086 15:17:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:25.086 15:17:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:25.086 15:17:28 -- common/autotest_common.sh@10 -- # set +x 00:16:25.086 15:17:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:25.086 15:17:28 -- nvmf/common.sh@470 -- # nvmfpid=614782 00:16:25.086 15:17:28 -- nvmf/common.sh@471 -- # waitforlisten 614782 00:16:25.086 15:17:28 -- common/autotest_common.sh@817 -- # '[' -z 614782 ']' 00:16:25.086 15:17:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:25.086 15:17:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:25.086 15:17:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:25.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:25.086 15:17:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:25.086 15:17:28 -- common/autotest_common.sh@10 -- # set +x 00:16:25.086 [2024-04-24 15:17:28.988208] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:25.086 [2024-04-24 15:17:28.988264] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:25.346 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.346 [2024-04-24 15:17:29.068498] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:25.346 [2024-04-24 15:17:29.153120] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:25.346 [2024-04-24 15:17:29.153159] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:25.346 [2024-04-24 15:17:29.153169] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:25.346 [2024-04-24 15:17:29.153178] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:25.346 [2024-04-24 15:17:29.153185] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:25.346 [2024-04-24 15:17:29.153235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:25.346 [2024-04-24 15:17:29.153326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:25.346 [2024-04-24 15:17:29.153403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:25.346 [2024-04-24 15:17:29.153405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:25.915 15:17:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:25.915 15:17:29 -- common/autotest_common.sh@850 -- # return 0 00:16:25.915 15:17:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:25.915 15:17:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:25.915 15:17:29 -- common/autotest_common.sh@10 -- # set +x 00:16:26.175 15:17:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:26.175 15:17:29 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:26.175 [2024-04-24 15:17:30.034561] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x2091910/0x2090f50) succeed. 00:16:26.175 [2024-04-24 15:17:30.045275] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x2092c80/0x20914d0) succeed. 00:16:26.175 [2024-04-24 15:17:30.045313] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:26.175 15:17:30 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:16:26.175 15:17:30 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:16:26.175 15:17:30 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:26.434 Malloc1 00:16:26.434 15:17:30 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:26.693 Malloc2 00:16:26.693 15:17:30 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:26.953 15:17:30 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:16:26.953 15:17:30 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:27.215 [2024-04-24 15:17:31.010719] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:27.215 15:17:31 -- target/ns_masking.sh@61 -- # connect 00:16:27.215 15:17:31 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0beee5f9-8cad-47ab-b339-1ba51ac306e7 -a 192.168.100.8 -s 4420 -i 4 00:16:27.474 15:17:31 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:16:27.474 15:17:31 -- common/autotest_common.sh@1184 -- # local i=0 00:16:27.474 15:17:31 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:27.474 15:17:31 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:16:27.474 15:17:31 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:29.382 15:17:33 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:29.382 15:17:33 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:29.382 15:17:33 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:29.382 15:17:33 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:16:29.382 15:17:33 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:29.382 15:17:33 -- common/autotest_common.sh@1194 -- # return 0 00:16:29.382 15:17:33 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:29.382 15:17:33 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:29.382 15:17:33 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:29.382 15:17:33 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:29.382 15:17:33 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:16:29.382 15:17:33 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:29.382 15:17:33 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:29.382 [ 0]:0x1 00:16:29.382 15:17:33 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:29.382 15:17:33 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:29.382 15:17:33 -- target/ns_masking.sh@40 -- # nguid=6f222e974fdc48d3935faf02f6eaead5 00:16:29.382 15:17:33 -- target/ns_masking.sh@41 -- # [[ 6f222e974fdc48d3935faf02f6eaead5 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:29.382 15:17:33 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:16:29.643 15:17:33 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:16:29.643 15:17:33 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:29.643 15:17:33 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:29.643 [ 0]:0x1 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # nguid=6f222e974fdc48d3935faf02f6eaead5 00:16:29.643 15:17:33 -- target/ns_masking.sh@41 -- # [[ 6f222e974fdc48d3935faf02f6eaead5 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:29.643 15:17:33 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:16:29.643 15:17:33 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:29.643 15:17:33 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:29.643 [ 1]:0x2 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:29.643 15:17:33 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:29.643 15:17:33 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:29.643 15:17:33 -- target/ns_masking.sh@69 -- # disconnect 00:16:29.643 15:17:33 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:30.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:30.211 15:17:33 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:30.211 15:17:34 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:16:30.471 15:17:34 -- target/ns_masking.sh@77 -- # connect 1 00:16:30.471 15:17:34 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0beee5f9-8cad-47ab-b339-1ba51ac306e7 -a 192.168.100.8 -s 4420 -i 4 00:16:30.471 15:17:34 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:16:30.471 15:17:34 -- common/autotest_common.sh@1184 -- # local i=0 00:16:30.471 15:17:34 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:30.471 15:17:34 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:16:30.471 15:17:34 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:16:30.471 15:17:34 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:33.009 15:17:36 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:33.009 15:17:36 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:33.009 15:17:36 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:33.009 15:17:36 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:16:33.009 15:17:36 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:33.009 15:17:36 -- common/autotest_common.sh@1194 -- # return 0 00:16:33.009 15:17:36 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:33.009 15:17:36 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:33.009 15:17:36 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:33.009 15:17:36 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:33.009 15:17:36 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:16:33.009 15:17:36 -- common/autotest_common.sh@638 -- # local es=0 00:16:33.009 15:17:36 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:33.009 15:17:36 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:33.009 15:17:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:33.009 15:17:36 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:33.009 15:17:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:33.009 15:17:36 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:33.009 15:17:36 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.009 15:17:36 -- common/autotest_common.sh@641 -- # es=1 00:16:33.009 15:17:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:33.009 15:17:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:33.009 15:17:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:33.009 15:17:36 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.009 [ 0]:0x2 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.009 15:17:36 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:33.009 15:17:36 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.009 15:17:36 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:33.009 15:17:36 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.009 15:17:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:33.009 [ 0]:0x1 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # nguid=6f222e974fdc48d3935faf02f6eaead5 00:16:33.010 15:17:36 -- target/ns_masking.sh@41 -- # [[ 6f222e974fdc48d3935faf02f6eaead5 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.010 15:17:36 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:16:33.010 15:17:36 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:33.010 15:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.010 [ 1]:0x2 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.010 15:17:36 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:33.010 15:17:36 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.010 15:17:36 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:33.270 15:17:36 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:16:33.270 15:17:36 -- common/autotest_common.sh@638 -- # local es=0 00:16:33.270 15:17:36 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:33.270 15:17:36 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:33.270 15:17:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:33.270 15:17:36 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:33.270 15:17:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:33.270 15:17:36 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:33.270 15:17:36 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.270 15:17:36 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:33.270 15:17:36 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:33.270 15:17:36 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.270 15:17:37 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:33.270 15:17:37 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.270 15:17:37 -- common/autotest_common.sh@641 -- # es=1 00:16:33.270 15:17:37 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:33.270 15:17:37 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:33.270 15:17:37 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:33.270 15:17:37 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:16:33.270 15:17:37 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:33.270 15:17:37 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:33.270 [ 0]:0x2 00:16:33.270 15:17:37 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:33.270 15:17:37 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:33.270 15:17:37 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:33.270 15:17:37 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:33.270 15:17:37 -- target/ns_masking.sh@91 -- # disconnect 00:16:33.270 15:17:37 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:33.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:33.529 15:17:37 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:33.789 15:17:37 -- target/ns_masking.sh@95 -- # connect 2 00:16:33.789 15:17:37 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0beee5f9-8cad-47ab-b339-1ba51ac306e7 -a 192.168.100.8 -s 4420 -i 4 00:16:33.789 15:17:37 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:16:33.789 15:17:37 -- common/autotest_common.sh@1184 -- # local i=0 00:16:33.789 15:17:37 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:33.789 15:17:37 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:16:33.789 15:17:37 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:16:33.789 15:17:37 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:36.325 15:17:39 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:36.325 15:17:39 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:36.325 15:17:39 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:36.325 15:17:39 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:16:36.325 15:17:39 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:36.325 15:17:39 -- common/autotest_common.sh@1194 -- # return 0 00:16:36.325 15:17:39 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:16:36.325 15:17:39 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:16:36.326 15:17:39 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:16:36.326 15:17:39 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:16:36.326 15:17:39 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:16:36.326 15:17:39 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.326 15:17:39 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:36.326 [ 0]:0x1 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # nguid=6f222e974fdc48d3935faf02f6eaead5 00:16:36.326 15:17:39 -- target/ns_masking.sh@41 -- # [[ 6f222e974fdc48d3935faf02f6eaead5 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.326 15:17:39 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:16:36.326 15:17:39 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.326 15:17:39 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:36.326 [ 1]:0x2 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.326 15:17:39 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:36.326 15:17:39 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.326 15:17:39 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:16:36.326 15:17:40 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:16:36.326 15:17:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:36.326 15:17:40 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:36.326 15:17:40 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.326 15:17:40 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:36.326 15:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.326 15:17:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:36.326 15:17:40 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.326 15:17:40 -- common/autotest_common.sh@641 -- # es=1 00:16:36.326 15:17:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:36.326 15:17:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:36.326 15:17:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:36.326 15:17:40 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:16:36.326 15:17:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:36.326 15:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.326 [ 0]:0x2 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.326 15:17:40 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:36.326 15:17:40 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.326 15:17:40 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:36.326 15:17:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:36.326 15:17:40 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:36.326 15:17:40 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.326 15:17:40 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:36.326 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.326 15:17:40 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:16:36.326 15:17:40 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:16:36.326 15:17:40 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:16:36.585 [2024-04-24 15:17:40.323235] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:16:36.585 request: 00:16:36.585 { 00:16:36.585 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.585 "nsid": 2, 00:16:36.585 "host": "nqn.2016-06.io.spdk:host1", 00:16:36.585 "method": "nvmf_ns_remove_host", 00:16:36.585 "req_id": 1 00:16:36.585 } 00:16:36.585 Got JSON-RPC error response 00:16:36.585 response: 00:16:36.585 { 00:16:36.585 "code": -32602, 00:16:36.585 "message": "Invalid parameters" 00:16:36.585 } 00:16:36.585 15:17:40 -- common/autotest_common.sh@641 -- # es=1 00:16:36.585 15:17:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:36.585 15:17:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:36.585 15:17:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:36.585 15:17:40 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:16:36.585 15:17:40 -- common/autotest_common.sh@638 -- # local es=0 00:16:36.585 15:17:40 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:16:36.585 15:17:40 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:16:36.585 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.585 15:17:40 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:16:36.585 15:17:40 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:36.585 15:17:40 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:16:36.585 15:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.585 15:17:40 -- target/ns_masking.sh@39 -- # grep 0x1 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:16:36.585 15:17:40 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.585 15:17:40 -- common/autotest_common.sh@641 -- # es=1 00:16:36.585 15:17:40 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:36.585 15:17:40 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:36.585 15:17:40 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:36.585 15:17:40 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:16:36.585 15:17:40 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:16:36.585 15:17:40 -- target/ns_masking.sh@39 -- # grep 0x2 00:16:36.585 [ 0]:0x2 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:16:36.585 15:17:40 -- target/ns_masking.sh@40 -- # nguid=d7e0952c95e34d698e07a7fe51be2256 00:16:36.585 15:17:40 -- target/ns_masking.sh@41 -- # [[ d7e0952c95e34d698e07a7fe51be2256 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:16:36.585 15:17:40 -- target/ns_masking.sh@108 -- # disconnect 00:16:36.585 15:17:40 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:37.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:37.155 15:17:40 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:37.155 15:17:40 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:16:37.155 15:17:40 -- target/ns_masking.sh@114 -- # nvmftestfini 00:16:37.155 15:17:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:37.155 15:17:40 -- nvmf/common.sh@117 -- # sync 00:16:37.155 15:17:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:37.155 15:17:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:37.155 15:17:40 -- nvmf/common.sh@120 -- # set +e 00:16:37.155 15:17:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:37.155 15:17:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:37.155 rmmod nvme_rdma 00:16:37.155 rmmod nvme_fabrics 00:16:37.155 15:17:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:37.155 15:17:41 -- nvmf/common.sh@124 -- # set -e 00:16:37.155 15:17:41 -- nvmf/common.sh@125 -- # return 0 00:16:37.155 15:17:41 -- nvmf/common.sh@478 -- # '[' -n 614782 ']' 00:16:37.155 15:17:41 -- nvmf/common.sh@479 -- # killprocess 614782 00:16:37.155 15:17:41 -- common/autotest_common.sh@936 -- # '[' -z 614782 ']' 00:16:37.155 15:17:41 -- common/autotest_common.sh@940 -- # kill -0 614782 00:16:37.155 15:17:41 -- common/autotest_common.sh@941 -- # uname 00:16:37.155 15:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:37.155 15:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 614782 00:16:37.414 15:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:37.414 15:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:37.414 15:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 614782' 00:16:37.414 killing process with pid 614782 00:16:37.414 15:17:41 -- common/autotest_common.sh@955 -- # kill 614782 00:16:37.414 15:17:41 -- common/autotest_common.sh@960 -- # wait 614782 00:16:37.414 [2024-04-24 15:17:41.116507] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:37.673 15:17:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:37.673 15:17:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:37.673 00:16:37.673 real 0m19.429s 00:16:37.673 user 0m53.597s 00:16:37.673 sys 0m6.749s 00:16:37.673 15:17:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:37.673 15:17:41 -- common/autotest_common.sh@10 -- # set +x 00:16:37.673 ************************************ 00:16:37.673 END TEST nvmf_ns_masking 00:16:37.673 ************************************ 00:16:37.673 15:17:41 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:16:37.673 15:17:41 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:16:37.673 15:17:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:37.673 15:17:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:37.673 15:17:41 -- common/autotest_common.sh@10 -- # set +x 00:16:37.673 ************************************ 00:16:37.673 START TEST nvmf_nvme_cli 00:16:37.673 ************************************ 00:16:37.673 15:17:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:16:37.933 * Looking for test storage... 00:16:37.933 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:37.933 15:17:41 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:37.933 15:17:41 -- nvmf/common.sh@7 -- # uname -s 00:16:37.933 15:17:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:37.933 15:17:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:37.933 15:17:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:37.933 15:17:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:37.933 15:17:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:37.933 15:17:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:37.933 15:17:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:37.933 15:17:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:37.933 15:17:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:37.933 15:17:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:37.933 15:17:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:16:37.933 15:17:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:16:37.933 15:17:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:37.933 15:17:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:37.933 15:17:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:37.933 15:17:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:37.933 15:17:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:37.933 15:17:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:37.933 15:17:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:37.933 15:17:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:37.933 15:17:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.933 15:17:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.933 15:17:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.933 15:17:41 -- paths/export.sh@5 -- # export PATH 00:16:37.933 15:17:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:37.933 15:17:41 -- nvmf/common.sh@47 -- # : 0 00:16:37.933 15:17:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:37.933 15:17:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:37.934 15:17:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:37.934 15:17:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:37.934 15:17:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:37.934 15:17:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:37.934 15:17:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:37.934 15:17:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:37.934 15:17:41 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:37.934 15:17:41 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:37.934 15:17:41 -- target/nvme_cli.sh@14 -- # devs=() 00:16:37.934 15:17:41 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:16:37.934 15:17:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:37.934 15:17:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:37.934 15:17:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:37.934 15:17:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:37.934 15:17:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:37.934 15:17:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:37.934 15:17:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:37.934 15:17:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:37.934 15:17:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:37.934 15:17:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:37.934 15:17:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:37.934 15:17:41 -- common/autotest_common.sh@10 -- # set +x 00:16:44.503 15:17:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:44.503 15:17:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:44.503 15:17:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:44.503 15:17:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:44.503 15:17:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:44.503 15:17:48 -- nvmf/common.sh@295 -- # net_devs=() 00:16:44.503 15:17:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@296 -- # e810=() 00:16:44.503 15:17:48 -- nvmf/common.sh@296 -- # local -ga e810 00:16:44.503 15:17:48 -- nvmf/common.sh@297 -- # x722=() 00:16:44.503 15:17:48 -- nvmf/common.sh@297 -- # local -ga x722 00:16:44.503 15:17:48 -- nvmf/common.sh@298 -- # mlx=() 00:16:44.503 15:17:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:44.503 15:17:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:44.503 15:17:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:16:44.503 Found 0000:18:00.0 (0x8086 - 0x1592) 00:16:44.503 15:17:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:44.503 15:17:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:16:44.503 Found 0000:18:00.1 (0x8086 - 0x1592) 00:16:44.503 15:17:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:44.503 15:17:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:44.503 15:17:48 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:44.503 15:17:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.503 15:17:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.503 15:17:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:16:44.503 Found net devices under 0000:18:00.0: cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:44.503 15:17:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:44.503 15:17:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:16:44.503 Found net devices under 0000:18:00.1: cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:44.503 15:17:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:44.503 15:17:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:44.503 15:17:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:44.503 15:17:48 -- nvmf/common.sh@58 -- # uname 00:16:44.503 15:17:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:44.503 15:17:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:44.503 15:17:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:44.503 15:17:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:44.503 15:17:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:44.503 15:17:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:44.503 15:17:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:44.503 15:17:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:44.503 15:17:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:44.503 15:17:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:44.503 15:17:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:44.503 15:17:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:44.503 15:17:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:44.503 15:17:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@105 -- # continue 2 00:16:44.503 15:17:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@105 -- # continue 2 00:16:44.503 15:17:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:44.503 15:17:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:44.503 15:17:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:44.503 15:17:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:44.503 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:44.503 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:16:44.503 altname enp24s0f0np0 00:16:44.503 altname ens785f0np0 00:16:44.503 inet 192.168.100.8/24 scope global cvl_0_0 00:16:44.503 valid_lft forever preferred_lft forever 00:16:44.503 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:16:44.503 valid_lft forever preferred_lft forever 00:16:44.503 15:17:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:44.503 15:17:48 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:44.503 15:17:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:44.503 15:17:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:44.503 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:44.503 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:16:44.503 altname enp24s0f1np1 00:16:44.503 altname ens785f1np1 00:16:44.503 inet 192.168.100.9/24 scope global cvl_0_1 00:16:44.503 valid_lft forever preferred_lft forever 00:16:44.503 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:16:44.503 valid_lft forever preferred_lft forever 00:16:44.503 15:17:48 -- nvmf/common.sh@411 -- # return 0 00:16:44.503 15:17:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:44.503 15:17:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:44.503 15:17:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:44.503 15:17:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:44.503 15:17:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:44.503 15:17:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:44.503 15:17:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:44.503 15:17:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:44.503 15:17:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@105 -- # continue 2 00:16:44.503 15:17:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:44.503 15:17:48 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:44.503 15:17:48 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@105 -- # continue 2 00:16:44.503 15:17:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:44.503 15:17:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:44.503 15:17:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:44.503 15:17:48 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:44.503 15:17:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:44.503 15:17:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:44.503 192.168.100.9' 00:16:44.503 15:17:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:44.503 192.168.100.9' 00:16:44.503 15:17:48 -- nvmf/common.sh@446 -- # head -n 1 00:16:44.503 15:17:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:44.503 15:17:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:44.503 192.168.100.9' 00:16:44.503 15:17:48 -- nvmf/common.sh@447 -- # head -n 1 00:16:44.503 15:17:48 -- nvmf/common.sh@447 -- # tail -n +2 00:16:44.503 15:17:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:44.503 15:17:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:44.503 15:17:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:44.503 15:17:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:44.503 15:17:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:44.503 15:17:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:44.503 15:17:48 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:16:44.504 15:17:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:44.504 15:17:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:44.504 15:17:48 -- common/autotest_common.sh@10 -- # set +x 00:16:44.504 15:17:48 -- nvmf/common.sh@470 -- # nvmfpid=619731 00:16:44.504 15:17:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:44.504 15:17:48 -- nvmf/common.sh@471 -- # waitforlisten 619731 00:16:44.504 15:17:48 -- common/autotest_common.sh@817 -- # '[' -z 619731 ']' 00:16:44.504 15:17:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:44.504 15:17:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:44.504 15:17:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:44.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:44.504 15:17:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:44.504 15:17:48 -- common/autotest_common.sh@10 -- # set +x 00:16:44.763 [2024-04-24 15:17:48.431512] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:44.763 [2024-04-24 15:17:48.431568] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:44.763 EAL: No free 2048 kB hugepages reported on node 1 00:16:44.763 [2024-04-24 15:17:48.514171] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:44.763 [2024-04-24 15:17:48.605165] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:44.763 [2024-04-24 15:17:48.605207] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:44.763 [2024-04-24 15:17:48.605222] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:44.763 [2024-04-24 15:17:48.605232] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:44.763 [2024-04-24 15:17:48.605240] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:44.763 [2024-04-24 15:17:48.605314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:44.763 [2024-04-24 15:17:48.605382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:44.763 [2024-04-24 15:17:48.605400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:44.763 [2024-04-24 15:17:48.605402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:45.386 15:17:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:45.386 15:17:49 -- common/autotest_common.sh@850 -- # return 0 00:16:45.386 15:17:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:45.386 15:17:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:45.386 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.386 15:17:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:45.709 15:17:49 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 [2024-04-24 15:17:49.308450] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1e2d910/0x1e2cf50) succeed. 00:16:45.709 [2024-04-24 15:17:49.319225] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1e2ec80/0x1e2d4d0) succeed. 00:16:45.709 [2024-04-24 15:17:49.319251] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 Malloc0 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 Malloc1 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 [2024-04-24 15:17:49.405229] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:16:45.709 15:17:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.709 15:17:49 -- common/autotest_common.sh@10 -- # set +x 00:16:45.709 15:17:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.709 15:17:49 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -a 192.168.100.8 -s 4420 00:16:45.709 00:16:45.709 Discovery Log Number of Records 2, Generation counter 2 00:16:45.709 =====Discovery Log Entry 0====== 00:16:45.709 trtype: rdma 00:16:45.709 adrfam: ipv4 00:16:45.709 subtype: current discovery subsystem 00:16:45.709 treq: not required 00:16:45.709 portid: 0 00:16:45.709 trsvcid: 4420 00:16:45.709 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:16:45.709 traddr: 192.168.100.8 00:16:45.709 eflags: explicit discovery connections, duplicate discovery information 00:16:45.709 rdma_prtype: not specified 00:16:45.709 rdma_qptype: connected 00:16:45.709 rdma_cms: rdma-cm 00:16:45.709 rdma_pkey: 0x0000 00:16:45.709 =====Discovery Log Entry 1====== 00:16:45.709 trtype: rdma 00:16:45.709 adrfam: ipv4 00:16:45.709 subtype: nvme subsystem 00:16:45.709 treq: not required 00:16:45.709 portid: 0 00:16:45.709 trsvcid: 4420 00:16:45.709 subnqn: nqn.2016-06.io.spdk:cnode1 00:16:45.709 traddr: 192.168.100.8 00:16:45.709 eflags: none 00:16:45.709 rdma_prtype: not specified 00:16:45.709 rdma_qptype: connected 00:16:45.709 rdma_cms: rdma-cm 00:16:45.709 rdma_pkey: 0x0000 00:16:45.709 15:17:49 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:16:45.709 15:17:49 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:16:45.709 15:17:49 -- nvmf/common.sh@511 -- # local dev _ 00:16:45.709 15:17:49 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:45.709 15:17:49 -- nvmf/common.sh@510 -- # nvme list 00:16:45.709 15:17:49 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:16:45.709 15:17:49 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:45.709 15:17:49 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:16:45.709 15:17:49 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:45.709 15:17:49 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:16:45.710 15:17:49 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:16:45.974 15:17:49 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:16:45.974 15:17:49 -- common/autotest_common.sh@1184 -- # local i=0 00:16:45.974 15:17:49 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:45.974 15:17:49 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:16:45.974 15:17:49 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:16:45.974 15:17:49 -- common/autotest_common.sh@1191 -- # sleep 2 00:16:47.881 15:17:51 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:16:47.881 15:17:51 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:16:47.881 15:17:51 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:16:47.881 15:17:51 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:16:47.881 15:17:51 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:16:47.881 15:17:51 -- common/autotest_common.sh@1194 -- # return 0 00:16:47.881 15:17:51 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:16:47.881 15:17:51 -- nvmf/common.sh@511 -- # local dev _ 00:16:47.881 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:47.881 15:17:51 -- nvmf/common.sh@510 -- # nvme list 00:16:47.881 15:17:51 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:16:47.881 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:47.881 15:17:51 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:16:47.881 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:47.881 15:17:51 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:16:47.881 15:17:51 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:16:47.881 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:47.881 15:17:51 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:16:47.881 15:17:51 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:16:47.881 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:47.881 15:17:51 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:16:47.881 /dev/nvme0n1 ]] 00:16:47.881 15:17:51 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:16:48.140 15:17:51 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:16:48.140 15:17:51 -- nvmf/common.sh@511 -- # local dev _ 00:16:48.140 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:48.140 15:17:51 -- nvmf/common.sh@510 -- # nvme list 00:16:48.140 15:17:51 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:16:48.140 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:48.140 15:17:51 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:16:48.140 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:48.140 15:17:51 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:16:48.140 15:17:51 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:16:48.140 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:48.140 15:17:51 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:16:48.140 15:17:51 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:16:48.140 15:17:51 -- nvmf/common.sh@513 -- # read -r dev _ 00:16:48.140 15:17:51 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:16:48.140 15:17:51 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:49.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:49.083 15:17:52 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:49.083 15:17:52 -- common/autotest_common.sh@1205 -- # local i=0 00:16:49.083 15:17:52 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:16:49.083 15:17:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.083 15:17:52 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:16:49.083 15:17:52 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.083 15:17:52 -- common/autotest_common.sh@1217 -- # return 0 00:16:49.084 15:17:52 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:16:49.084 15:17:52 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:49.084 15:17:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:49.084 15:17:52 -- common/autotest_common.sh@10 -- # set +x 00:16:49.084 15:17:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:49.084 15:17:52 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:16:49.084 15:17:52 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:16:49.084 15:17:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:49.084 15:17:52 -- nvmf/common.sh@117 -- # sync 00:16:49.084 15:17:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:49.084 15:17:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:49.084 15:17:52 -- nvmf/common.sh@120 -- # set +e 00:16:49.084 15:17:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:49.084 15:17:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:49.084 rmmod nvme_rdma 00:16:49.084 rmmod nvme_fabrics 00:16:49.084 15:17:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:49.084 15:17:52 -- nvmf/common.sh@124 -- # set -e 00:16:49.084 15:17:52 -- nvmf/common.sh@125 -- # return 0 00:16:49.084 15:17:52 -- nvmf/common.sh@478 -- # '[' -n 619731 ']' 00:16:49.084 15:17:52 -- nvmf/common.sh@479 -- # killprocess 619731 00:16:49.084 15:17:52 -- common/autotest_common.sh@936 -- # '[' -z 619731 ']' 00:16:49.084 15:17:52 -- common/autotest_common.sh@940 -- # kill -0 619731 00:16:49.084 15:17:52 -- common/autotest_common.sh@941 -- # uname 00:16:49.084 15:17:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:49.084 15:17:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 619731 00:16:49.084 15:17:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:49.084 15:17:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:49.084 15:17:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 619731' 00:16:49.084 killing process with pid 619731 00:16:49.084 15:17:52 -- common/autotest_common.sh@955 -- # kill 619731 00:16:49.084 15:17:52 -- common/autotest_common.sh@960 -- # wait 619731 00:16:49.084 [2024-04-24 15:17:52.879482] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:49.342 15:17:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:49.342 15:17:53 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:49.342 00:16:49.342 real 0m11.606s 00:16:49.342 user 0m20.066s 00:16:49.342 sys 0m5.651s 00:16:49.342 15:17:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:49.342 15:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:49.342 ************************************ 00:16:49.342 END TEST nvmf_nvme_cli 00:16:49.342 ************************************ 00:16:49.342 15:17:53 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:16:49.342 15:17:53 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:16:49.342 15:17:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:49.342 15:17:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:49.342 15:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:49.602 ************************************ 00:16:49.602 START TEST nvmf_host_management 00:16:49.602 ************************************ 00:16:49.602 15:17:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:16:49.602 * Looking for test storage... 00:16:49.602 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:16:49.602 15:17:53 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:16:49.602 15:17:53 -- nvmf/common.sh@7 -- # uname -s 00:16:49.602 15:17:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:49.602 15:17:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:49.602 15:17:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:49.602 15:17:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:49.602 15:17:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:49.602 15:17:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:49.602 15:17:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:49.602 15:17:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:49.602 15:17:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:49.602 15:17:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:49.602 15:17:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:16:49.602 15:17:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:16:49.603 15:17:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:49.603 15:17:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:49.603 15:17:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:49.603 15:17:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:49.603 15:17:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:16:49.603 15:17:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:49.603 15:17:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:49.603 15:17:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:49.603 15:17:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.603 15:17:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.603 15:17:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.603 15:17:53 -- paths/export.sh@5 -- # export PATH 00:16:49.603 15:17:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:49.603 15:17:53 -- nvmf/common.sh@47 -- # : 0 00:16:49.603 15:17:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:49.603 15:17:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:49.603 15:17:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:49.603 15:17:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:49.603 15:17:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:49.603 15:17:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:49.603 15:17:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:49.603 15:17:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:49.603 15:17:53 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:49.603 15:17:53 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:49.603 15:17:53 -- target/host_management.sh@105 -- # nvmftestinit 00:16:49.603 15:17:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:49.603 15:17:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:49.603 15:17:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:49.603 15:17:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:49.603 15:17:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:49.603 15:17:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:49.603 15:17:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:49.603 15:17:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:49.603 15:17:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:49.603 15:17:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:49.603 15:17:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:49.603 15:17:53 -- common/autotest_common.sh@10 -- # set +x 00:16:56.175 15:17:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:56.175 15:17:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:56.175 15:17:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:56.175 15:17:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:56.175 15:17:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:56.175 15:17:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:56.175 15:17:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:56.175 15:17:59 -- nvmf/common.sh@295 -- # net_devs=() 00:16:56.175 15:17:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:56.175 15:17:59 -- nvmf/common.sh@296 -- # e810=() 00:16:56.175 15:17:59 -- nvmf/common.sh@296 -- # local -ga e810 00:16:56.175 15:17:59 -- nvmf/common.sh@297 -- # x722=() 00:16:56.175 15:17:59 -- nvmf/common.sh@297 -- # local -ga x722 00:16:56.175 15:17:59 -- nvmf/common.sh@298 -- # mlx=() 00:16:56.175 15:17:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:56.175 15:17:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:56.175 15:17:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.175 15:17:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:16:56.175 Found 0000:18:00.0 (0x8086 - 0x1592) 00:16:56.175 15:17:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.175 15:17:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.175 15:17:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:16:56.175 Found 0000:18:00.1 (0x8086 - 0x1592) 00:16:56.175 15:17:59 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.175 15:17:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@377 -- # modinfo irdma 00:16:56.175 15:17:59 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:16:56.175 15:17:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.175 15:17:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.175 15:17:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.175 15:17:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:16:56.175 Found net devices under 0000:18:00.0: cvl_0_0 00:16:56.175 15:17:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.175 15:17:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.175 15:17:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.175 15:17:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:16:56.175 Found net devices under 0000:18:00.1: cvl_0_1 00:16:56.175 15:17:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.175 15:17:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:56.175 15:17:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:56.175 15:17:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:56.175 15:17:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:56.175 15:17:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:56.175 15:17:59 -- nvmf/common.sh@58 -- # uname 00:16:56.175 15:17:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:56.175 15:17:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:56.175 15:17:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:56.175 15:17:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:56.175 15:17:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:56.175 15:17:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:56.175 15:17:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:56.175 15:17:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:56.175 15:17:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:56.175 15:17:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:56.175 15:17:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:56.175 15:17:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.175 15:17:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.175 15:17:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.176 15:17:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.176 15:17:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.176 15:17:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@105 -- # continue 2 00:16:56.176 15:17:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@105 -- # continue 2 00:16:56.176 15:17:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.176 15:17:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.176 15:17:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:56.176 15:17:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:16:56.176 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:56.176 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:16:56.176 altname enp24s0f0np0 00:16:56.176 altname ens785f0np0 00:16:56.176 inet 192.168.100.8/24 scope global cvl_0_0 00:16:56.176 valid_lft forever preferred_lft forever 00:16:56.176 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:16:56.176 valid_lft forever preferred_lft forever 00:16:56.176 15:17:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.176 15:17:59 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.176 15:17:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:56.176 15:17:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:16:56.176 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:16:56.176 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:16:56.176 altname enp24s0f1np1 00:16:56.176 altname ens785f1np1 00:16:56.176 inet 192.168.100.9/24 scope global cvl_0_1 00:16:56.176 valid_lft forever preferred_lft forever 00:16:56.176 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:16:56.176 valid_lft forever preferred_lft forever 00:16:56.176 15:17:59 -- nvmf/common.sh@411 -- # return 0 00:16:56.176 15:17:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:56.176 15:17:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:56.176 15:17:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:56.176 15:17:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:56.176 15:17:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.176 15:17:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.176 15:17:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.176 15:17:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.176 15:17:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.176 15:17:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@105 -- # continue 2 00:16:56.176 15:17:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.176 15:17:59 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:16:56.176 15:17:59 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@105 -- # continue 2 00:16:56.176 15:17:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.176 15:17:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.176 15:17:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.176 15:17:59 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:16:56.176 15:17:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.176 15:17:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:56.176 192.168.100.9' 00:16:56.176 15:17:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:56.176 192.168.100.9' 00:16:56.176 15:17:59 -- nvmf/common.sh@446 -- # head -n 1 00:16:56.176 15:17:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:56.176 15:17:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:56.176 192.168.100.9' 00:16:56.176 15:17:59 -- nvmf/common.sh@447 -- # tail -n +2 00:16:56.176 15:17:59 -- nvmf/common.sh@447 -- # head -n 1 00:16:56.176 15:17:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:56.176 15:17:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:56.176 15:17:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:56.176 15:17:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:56.176 15:17:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:56.176 15:17:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:56.176 15:17:59 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:16:56.176 15:17:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:56.176 15:17:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:56.176 15:17:59 -- common/autotest_common.sh@10 -- # set +x 00:16:56.176 ************************************ 00:16:56.176 START TEST nvmf_host_management 00:16:56.176 ************************************ 00:16:56.176 15:17:59 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:16:56.176 15:17:59 -- target/host_management.sh@69 -- # starttarget 00:16:56.176 15:17:59 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:56.176 15:17:59 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:56.176 15:17:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:56.176 15:17:59 -- common/autotest_common.sh@10 -- # set +x 00:16:56.176 15:17:59 -- nvmf/common.sh@470 -- # nvmfpid=623700 00:16:56.176 15:17:59 -- nvmf/common.sh@471 -- # waitforlisten 623700 00:16:56.176 15:17:59 -- common/autotest_common.sh@817 -- # '[' -z 623700 ']' 00:16:56.176 15:17:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:56.176 15:17:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:56.176 15:17:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:56.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:56.176 15:17:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:56.176 15:17:59 -- common/autotest_common.sh@10 -- # set +x 00:16:56.176 15:17:59 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:56.176 [2024-04-24 15:17:59.833019] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:56.176 [2024-04-24 15:17:59.833069] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:56.176 EAL: No free 2048 kB hugepages reported on node 1 00:16:56.176 [2024-04-24 15:17:59.913584] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:56.176 [2024-04-24 15:17:59.998621] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:56.176 [2024-04-24 15:17:59.998664] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:56.176 [2024-04-24 15:17:59.998673] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:56.176 [2024-04-24 15:17:59.998682] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:56.176 [2024-04-24 15:17:59.998688] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:56.176 [2024-04-24 15:17:59.998789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.176 [2024-04-24 15:17:59.998865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:56.176 [2024-04-24 15:17:59.998964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:56.176 [2024-04-24 15:17:59.998965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:56.745 15:18:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:56.745 15:18:00 -- common/autotest_common.sh@850 -- # return 0 00:16:56.745 15:18:00 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:56.745 15:18:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:56.745 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 15:18:00 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:57.005 15:18:00 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:57.005 15:18:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.005 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 [2024-04-24 15:18:00.721650] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xfeec00/0xfee240) succeed. 00:16:57.005 [2024-04-24 15:18:00.732254] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xfeff70/0xfee7c0) succeed. 00:16:57.005 [2024-04-24 15:18:00.732277] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:16:57.005 15:18:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.005 15:18:00 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:57.005 15:18:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:57.005 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 15:18:00 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:57.005 15:18:00 -- target/host_management.sh@23 -- # cat 00:16:57.005 15:18:00 -- target/host_management.sh@30 -- # rpc_cmd 00:16:57.005 15:18:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:57.005 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 Malloc0 00:16:57.005 [2024-04-24 15:18:00.800204] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:57.005 15:18:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:57.005 15:18:00 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:57.005 15:18:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:57.005 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 15:18:00 -- target/host_management.sh@73 -- # perfpid=623899 00:16:57.005 15:18:00 -- target/host_management.sh@74 -- # waitforlisten 623899 /var/tmp/bdevperf.sock 00:16:57.005 15:18:00 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:57.005 15:18:00 -- common/autotest_common.sh@817 -- # '[' -z 623899 ']' 00:16:57.005 15:18:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:57.005 15:18:00 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:57.005 15:18:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:57.005 15:18:00 -- nvmf/common.sh@521 -- # config=() 00:16:57.005 15:18:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:57.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:57.005 15:18:00 -- nvmf/common.sh@521 -- # local subsystem config 00:16:57.005 15:18:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:57.005 15:18:00 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:57.005 15:18:00 -- common/autotest_common.sh@10 -- # set +x 00:16:57.005 15:18:00 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:57.005 { 00:16:57.005 "params": { 00:16:57.005 "name": "Nvme$subsystem", 00:16:57.005 "trtype": "$TEST_TRANSPORT", 00:16:57.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:57.005 "adrfam": "ipv4", 00:16:57.005 "trsvcid": "$NVMF_PORT", 00:16:57.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:57.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:57.005 "hdgst": ${hdgst:-false}, 00:16:57.005 "ddgst": ${ddgst:-false} 00:16:57.005 }, 00:16:57.005 "method": "bdev_nvme_attach_controller" 00:16:57.005 } 00:16:57.005 EOF 00:16:57.005 )") 00:16:57.005 15:18:00 -- nvmf/common.sh@543 -- # cat 00:16:57.005 15:18:00 -- nvmf/common.sh@545 -- # jq . 00:16:57.005 15:18:00 -- nvmf/common.sh@546 -- # IFS=, 00:16:57.005 15:18:00 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:57.005 "params": { 00:16:57.005 "name": "Nvme0", 00:16:57.005 "trtype": "rdma", 00:16:57.005 "traddr": "192.168.100.8", 00:16:57.005 "adrfam": "ipv4", 00:16:57.005 "trsvcid": "4420", 00:16:57.005 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:57.005 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:57.005 "hdgst": false, 00:16:57.005 "ddgst": false 00:16:57.005 }, 00:16:57.005 "method": "bdev_nvme_attach_controller" 00:16:57.005 }' 00:16:57.005 [2024-04-24 15:18:00.896035] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:57.005 [2024-04-24 15:18:00.896091] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid623899 ] 00:16:57.264 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.264 [2024-04-24 15:18:00.980212] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:57.264 [2024-04-24 15:18:01.062154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:57.523 Running I/O for 10 seconds... 00:16:58.092 15:18:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:58.092 15:18:01 -- common/autotest_common.sh@850 -- # return 0 00:16:58.092 15:18:01 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:58.092 15:18:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:58.092 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:16:58.092 15:18:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:58.092 15:18:01 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:58.092 15:18:01 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:58.092 15:18:01 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:58.092 15:18:01 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:58.092 15:18:01 -- target/host_management.sh@52 -- # local ret=1 00:16:58.092 15:18:01 -- target/host_management.sh@53 -- # local i 00:16:58.092 15:18:01 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:58.092 15:18:01 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:58.092 15:18:01 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:58.092 15:18:01 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:58.092 15:18:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:58.092 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:16:58.092 15:18:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:58.092 15:18:01 -- target/host_management.sh@55 -- # read_io_count=1596 00:16:58.092 15:18:01 -- target/host_management.sh@58 -- # '[' 1596 -ge 100 ']' 00:16:58.092 15:18:01 -- target/host_management.sh@59 -- # ret=0 00:16:58.092 15:18:01 -- target/host_management.sh@60 -- # break 00:16:58.092 15:18:01 -- target/host_management.sh@64 -- # return 0 00:16:58.092 15:18:01 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:58.092 15:18:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:58.092 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:16:58.092 15:18:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:58.092 15:18:01 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:58.092 15:18:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:58.092 15:18:01 -- common/autotest_common.sh@10 -- # set +x 00:16:58.092 15:18:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:58.092 15:18:01 -- target/host_management.sh@87 -- # sleep 1 00:16:58.663 [2024-04-24 15:18:02.356507] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:58.663 [2024-04-24 15:18:02.356551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:89216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200018e0f880 len:0x10000 key:0x7af20f19 00:16:58.663 [2024-04-24 15:18:02.356565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:89344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a4b040 len:0x10000 key:0x9b584ae4 00:16:58.663 [2024-04-24 15:18:02.356596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:89472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a3afc0 len:0x10000 key:0x9b584ae4 00:16:58.663 [2024-04-24 15:18:02.356618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:89600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a2af40 len:0x10000 key:0x9b584ae4 00:16:58.663 [2024-04-24 15:18:02.356646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:89728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a1aec0 len:0x10000 key:0x9b584ae4 00:16:58.663 [2024-04-24 15:18:02.356667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:89856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200003a0ae40 len:0x10000 key:0x9b584ae4 00:16:58.663 [2024-04-24 15:18:02.356690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:89984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ea980 len:0x10000 key:0x9dd1e427 00:16:58.663 [2024-04-24 15:18:02.356712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bc1f000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:82048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbbc000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:82176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbdd000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:82304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb7a000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:82432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb9b000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:82560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb38000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:82688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb59000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:82816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bbfe000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:82944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000bb17000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:83072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dcdd000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:83200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dcbc000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:83328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dc9b000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.356986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.356998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:83456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dc7a000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:83584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dc59000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:83712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dc38000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:83840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dc17000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:83968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dbf6000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:84096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dbd5000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:84224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dbb4000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:84352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000db93000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:84480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000db72000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:84608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000db51000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:84736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000db30000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.663 [2024-04-24 15:18:02.357230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:84864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df2f000 len:0x10000 key:0xa1da3376 00:16:58.663 [2024-04-24 15:18:02.357240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:84992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df0e000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:85120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000deed000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:85248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000decc000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:85376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000deab000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:85504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de8a000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:85632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de69000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:85760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de48000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:85888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de27000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:86016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de06000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:86144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dde5000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:86272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ddc4000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:86400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dda3000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:86528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd82000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:86656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd61000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:86784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd40000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:86912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e13f000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:87040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e11e000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:87168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0fd000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:87296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0dc000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:87424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e0bb000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:87552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e09a000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:87680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e079000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:87808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e058000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:87936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e037000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:88064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e016000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:88192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dff5000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:88320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dfd4000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:88448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dfb3000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:88576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df92000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:88704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df71000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:88832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000df50000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:88960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e34f000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.357924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:89088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e32e000 len:0x10000 key:0xa1da3376 00:16:58.664 [2024-04-24 15:18:02.357933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20cd6f0 sqhd:15c0 p:0 m:0 dnr:0 00:16:58.664 [2024-04-24 15:18:02.358328] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:16:58.664 [2024-04-24 15:18:02.359259] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:58.664 task offset: 89216 on job bdev=Nvme0n1 fails 00:16:58.664 00:16:58.664 Latency(us) 00:16:58.664 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:58.664 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:58.664 Job: Nvme0n1 ended in about 1.12 seconds with error 00:16:58.664 Verification LBA range: start 0x0 length 0x400 00:16:58.664 Nvme0n1 : 1.12 1480.07 92.50 56.93 0.00 41090.97 1666.89 579908.12 00:16:58.665 =================================================================================================================== 00:16:58.665 Total : 1480.07 92.50 56.93 0.00 41090.97 1666.89 579908.12 00:16:58.665 [2024-04-24 15:18:02.361088] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:58.665 [2024-04-24 15:18:02.361103] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:16:58.665 [2024-04-24 15:18:02.374692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:58.665 [2024-04-24 15:18:02.394607] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:58.925 15:18:02 -- target/host_management.sh@91 -- # kill -9 623899 00:16:58.925 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (623899) - No such process 00:16:58.925 15:18:02 -- target/host_management.sh@91 -- # true 00:16:58.925 15:18:02 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:58.925 15:18:02 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:58.925 15:18:02 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:58.925 15:18:02 -- nvmf/common.sh@521 -- # config=() 00:16:58.925 15:18:02 -- nvmf/common.sh@521 -- # local subsystem config 00:16:58.925 15:18:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:16:58.925 15:18:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:16:58.925 { 00:16:58.925 "params": { 00:16:58.925 "name": "Nvme$subsystem", 00:16:58.925 "trtype": "$TEST_TRANSPORT", 00:16:58.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:58.925 "adrfam": "ipv4", 00:16:58.925 "trsvcid": "$NVMF_PORT", 00:16:58.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:58.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:58.925 "hdgst": ${hdgst:-false}, 00:16:58.925 "ddgst": ${ddgst:-false} 00:16:58.925 }, 00:16:58.925 "method": "bdev_nvme_attach_controller" 00:16:58.925 } 00:16:58.925 EOF 00:16:58.925 )") 00:16:58.925 15:18:02 -- nvmf/common.sh@543 -- # cat 00:16:58.925 15:18:02 -- nvmf/common.sh@545 -- # jq . 00:16:58.925 15:18:02 -- nvmf/common.sh@546 -- # IFS=, 00:16:58.925 15:18:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:16:58.925 "params": { 00:16:58.925 "name": "Nvme0", 00:16:58.925 "trtype": "rdma", 00:16:58.925 "traddr": "192.168.100.8", 00:16:58.925 "adrfam": "ipv4", 00:16:58.925 "trsvcid": "4420", 00:16:58.925 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:58.925 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:58.925 "hdgst": false, 00:16:58.925 "ddgst": false 00:16:58.925 }, 00:16:58.925 "method": "bdev_nvme_attach_controller" 00:16:58.925 }' 00:16:59.185 [2024-04-24 15:18:02.848597] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:16:59.185 [2024-04-24 15:18:02.848655] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid624231 ] 00:16:59.185 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.185 [2024-04-24 15:18:02.931024] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:59.185 [2024-04-24 15:18:03.009956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:59.445 Running I/O for 1 seconds... 00:17:00.383 00:17:00.383 Latency(us) 00:17:00.383 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:00.383 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:00.383 Verification LBA range: start 0x0 length 0x400 00:17:00.383 Nvme0n1 : 1.00 3182.56 198.91 0.00 0.00 19699.09 1517.30 33280.89 00:17:00.383 =================================================================================================================== 00:17:00.383 Total : 3182.56 198.91 0.00 0.00 19699.09 1517.30 33280.89 00:17:00.643 15:18:04 -- target/host_management.sh@102 -- # stoptarget 00:17:00.643 15:18:04 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:00.643 15:18:04 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:00.643 15:18:04 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:00.643 15:18:04 -- target/host_management.sh@40 -- # nvmftestfini 00:17:00.643 15:18:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:00.643 15:18:04 -- nvmf/common.sh@117 -- # sync 00:17:00.643 15:18:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:00.643 15:18:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:00.643 15:18:04 -- nvmf/common.sh@120 -- # set +e 00:17:00.643 15:18:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:00.643 15:18:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:00.643 rmmod nvme_rdma 00:17:00.643 rmmod nvme_fabrics 00:17:00.643 15:18:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:00.643 15:18:04 -- nvmf/common.sh@124 -- # set -e 00:17:00.643 15:18:04 -- nvmf/common.sh@125 -- # return 0 00:17:00.643 15:18:04 -- nvmf/common.sh@478 -- # '[' -n 623700 ']' 00:17:00.643 15:18:04 -- nvmf/common.sh@479 -- # killprocess 623700 00:17:00.643 15:18:04 -- common/autotest_common.sh@936 -- # '[' -z 623700 ']' 00:17:00.643 15:18:04 -- common/autotest_common.sh@940 -- # kill -0 623700 00:17:00.643 15:18:04 -- common/autotest_common.sh@941 -- # uname 00:17:00.643 15:18:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:00.643 15:18:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 623700 00:17:00.902 15:18:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:00.902 15:18:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:00.902 15:18:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 623700' 00:17:00.902 killing process with pid 623700 00:17:00.902 15:18:04 -- common/autotest_common.sh@955 -- # kill 623700 00:17:00.902 15:18:04 -- common/autotest_common.sh@960 -- # wait 623700 00:17:00.902 [2024-04-24 15:18:04.591328] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:01.162 [2024-04-24 15:18:04.819269] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:01.162 15:18:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:01.162 15:18:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:01.162 00:17:01.162 real 0m5.059s 00:17:01.162 user 0m22.533s 00:17:01.162 sys 0m0.994s 00:17:01.162 15:18:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:01.162 15:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:01.162 ************************************ 00:17:01.162 END TEST nvmf_host_management 00:17:01.162 ************************************ 00:17:01.162 15:18:04 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:17:01.162 00:17:01.162 real 0m11.525s 00:17:01.162 user 0m24.240s 00:17:01.162 sys 0m5.774s 00:17:01.162 15:18:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:01.162 15:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:01.162 ************************************ 00:17:01.162 END TEST nvmf_host_management 00:17:01.162 ************************************ 00:17:01.162 15:18:04 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:01.162 15:18:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:01.162 15:18:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:01.162 15:18:04 -- common/autotest_common.sh@10 -- # set +x 00:17:01.421 ************************************ 00:17:01.422 START TEST nvmf_lvol 00:17:01.422 ************************************ 00:17:01.422 15:18:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:01.422 * Looking for test storage... 00:17:01.422 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:17:01.422 15:18:05 -- nvmf/common.sh@7 -- # uname -s 00:17:01.422 15:18:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:01.422 15:18:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:01.422 15:18:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:01.422 15:18:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:01.422 15:18:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:01.422 15:18:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:01.422 15:18:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:01.422 15:18:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:01.422 15:18:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:01.422 15:18:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:01.422 15:18:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:17:01.422 15:18:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:17:01.422 15:18:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:01.422 15:18:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:01.422 15:18:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:01.422 15:18:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:01.422 15:18:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:17:01.422 15:18:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:01.422 15:18:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:01.422 15:18:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:01.422 15:18:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.422 15:18:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.422 15:18:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.422 15:18:05 -- paths/export.sh@5 -- # export PATH 00:17:01.422 15:18:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:01.422 15:18:05 -- nvmf/common.sh@47 -- # : 0 00:17:01.422 15:18:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:01.422 15:18:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:01.422 15:18:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:01.422 15:18:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:01.422 15:18:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:01.422 15:18:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:01.422 15:18:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:01.422 15:18:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:01.422 15:18:05 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:01.422 15:18:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:01.422 15:18:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:01.422 15:18:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:01.422 15:18:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:01.422 15:18:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:01.422 15:18:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:01.422 15:18:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:01.422 15:18:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:01.422 15:18:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:01.422 15:18:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:01.422 15:18:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:01.422 15:18:05 -- common/autotest_common.sh@10 -- # set +x 00:17:09.546 15:18:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:09.546 15:18:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:09.546 15:18:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:09.546 15:18:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:09.546 15:18:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:09.546 15:18:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:09.546 15:18:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:09.546 15:18:12 -- nvmf/common.sh@295 -- # net_devs=() 00:17:09.546 15:18:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:09.546 15:18:12 -- nvmf/common.sh@296 -- # e810=() 00:17:09.546 15:18:12 -- nvmf/common.sh@296 -- # local -ga e810 00:17:09.546 15:18:12 -- nvmf/common.sh@297 -- # x722=() 00:17:09.546 15:18:12 -- nvmf/common.sh@297 -- # local -ga x722 00:17:09.546 15:18:12 -- nvmf/common.sh@298 -- # mlx=() 00:17:09.546 15:18:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:09.546 15:18:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:09.546 15:18:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:17:09.546 Found 0000:18:00.0 (0x8086 - 0x1592) 00:17:09.546 15:18:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:09.546 15:18:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:17:09.546 Found 0000:18:00.1 (0x8086 - 0x1592) 00:17:09.546 15:18:12 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:09.546 15:18:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@377 -- # modinfo irdma 00:17:09.546 15:18:12 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:17:09.546 15:18:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.546 15:18:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.546 15:18:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:17:09.546 Found net devices under 0000:18:00.0: cvl_0_0 00:17:09.546 15:18:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:09.546 15:18:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:09.546 15:18:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:17:09.546 Found net devices under 0000:18:00.1: cvl_0_1 00:17:09.546 15:18:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:09.546 15:18:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:09.546 15:18:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:09.546 15:18:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:09.546 15:18:12 -- nvmf/common.sh@58 -- # uname 00:17:09.546 15:18:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:09.546 15:18:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:09.546 15:18:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:09.546 15:18:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:09.546 15:18:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:09.546 15:18:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:09.546 15:18:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:09.546 15:18:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:09.546 15:18:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:09.546 15:18:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:09.546 15:18:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:09.546 15:18:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:09.546 15:18:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:09.546 15:18:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:09.546 15:18:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:09.546 15:18:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:09.546 15:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:09.546 15:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:09.546 15:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.546 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:09.546 15:18:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:09.546 15:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:09.546 15:18:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:09.546 15:18:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:17:09.546 15:18:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:09.547 15:18:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:09.547 15:18:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:17:09.547 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:09.547 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:17:09.547 altname enp24s0f0np0 00:17:09.547 altname ens785f0np0 00:17:09.547 inet 192.168.100.8/24 scope global cvl_0_0 00:17:09.547 valid_lft forever preferred_lft forever 00:17:09.547 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:17:09.547 valid_lft forever preferred_lft forever 00:17:09.547 15:18:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:09.547 15:18:12 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:09.547 15:18:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:09.547 15:18:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:17:09.547 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:09.547 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:17:09.547 altname enp24s0f1np1 00:17:09.547 altname ens785f1np1 00:17:09.547 inet 192.168.100.9/24 scope global cvl_0_1 00:17:09.547 valid_lft forever preferred_lft forever 00:17:09.547 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:17:09.547 valid_lft forever preferred_lft forever 00:17:09.547 15:18:12 -- nvmf/common.sh@411 -- # return 0 00:17:09.547 15:18:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:09.547 15:18:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:09.547 15:18:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:09.547 15:18:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:09.547 15:18:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:09.547 15:18:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:09.547 15:18:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:09.547 15:18:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:09.547 15:18:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:09.547 15:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:09.547 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.547 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.547 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:09.547 15:18:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:09.547 15:18:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:09.547 15:18:12 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:09.547 15:18:12 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@105 -- # continue 2 00:17:09.547 15:18:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:09.547 15:18:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:09.547 15:18:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:09.547 15:18:12 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:09.547 15:18:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:09.547 15:18:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:09.547 192.168.100.9' 00:17:09.547 15:18:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:09.547 192.168.100.9' 00:17:09.547 15:18:12 -- nvmf/common.sh@446 -- # head -n 1 00:17:09.547 15:18:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:09.547 15:18:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:09.547 192.168.100.9' 00:17:09.547 15:18:12 -- nvmf/common.sh@447 -- # head -n 1 00:17:09.547 15:18:12 -- nvmf/common.sh@447 -- # tail -n +2 00:17:09.547 15:18:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:09.547 15:18:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:09.547 15:18:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:09.547 15:18:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:09.547 15:18:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:09.547 15:18:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:09.547 15:18:12 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:09.547 15:18:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:09.547 15:18:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:09.547 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:09.547 15:18:12 -- nvmf/common.sh@470 -- # nvmfpid=628187 00:17:09.547 15:18:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:09.547 15:18:12 -- nvmf/common.sh@471 -- # waitforlisten 628187 00:17:09.547 15:18:12 -- common/autotest_common.sh@817 -- # '[' -z 628187 ']' 00:17:09.547 15:18:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:09.547 15:18:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:09.547 15:18:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:09.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:09.547 15:18:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:09.547 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:17:09.547 [2024-04-24 15:18:12.318987] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:17:09.547 [2024-04-24 15:18:12.319045] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:09.547 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.547 [2024-04-24 15:18:12.401748] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:09.547 [2024-04-24 15:18:12.486227] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:09.547 [2024-04-24 15:18:12.486276] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:09.547 [2024-04-24 15:18:12.486285] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:09.547 [2024-04-24 15:18:12.486293] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:09.547 [2024-04-24 15:18:12.486300] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:09.547 [2024-04-24 15:18:12.486358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.547 [2024-04-24 15:18:12.486443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:09.547 [2024-04-24 15:18:12.486445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:09.547 15:18:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:09.547 15:18:13 -- common/autotest_common.sh@850 -- # return 0 00:17:09.547 15:18:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:09.547 15:18:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:09.547 15:18:13 -- common/autotest_common.sh@10 -- # set +x 00:17:09.547 15:18:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:09.547 15:18:13 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:09.547 [2024-04-24 15:18:13.342779] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x567de0/0x567420) succeed. 00:17:09.547 [2024-04-24 15:18:13.353187] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x569110/0x5679a0) succeed. 00:17:09.547 [2024-04-24 15:18:13.353216] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:17:09.547 15:18:13 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:09.807 15:18:13 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:09.807 15:18:13 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:10.066 15:18:13 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:10.066 15:18:13 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:10.066 15:18:13 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:10.325 15:18:14 -- target/nvmf_lvol.sh@29 -- # lvs=7ce3974a-6721-44f0-b8ef-a0fb00cf5ef7 00:17:10.325 15:18:14 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7ce3974a-6721-44f0-b8ef-a0fb00cf5ef7 lvol 20 00:17:10.583 15:18:14 -- target/nvmf_lvol.sh@32 -- # lvol=a0c12683-d54a-4ee3-9cb8-384fae9d59c9 00:17:10.584 15:18:14 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:10.842 15:18:14 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a0c12683-d54a-4ee3-9cb8-384fae9d59c9 00:17:10.843 15:18:14 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:11.101 [2024-04-24 15:18:14.854448] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:11.101 15:18:14 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:11.360 15:18:15 -- target/nvmf_lvol.sh@42 -- # perf_pid=628575 00:17:11.360 15:18:15 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:11.360 15:18:15 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:11.360 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.296 15:18:16 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot a0c12683-d54a-4ee3-9cb8-384fae9d59c9 MY_SNAPSHOT 00:17:12.555 15:18:16 -- target/nvmf_lvol.sh@47 -- # snapshot=e736c3d8-ca00-4878-b447-73b1624b801e 00:17:12.555 15:18:16 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize a0c12683-d54a-4ee3-9cb8-384fae9d59c9 30 00:17:12.555 15:18:16 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone e736c3d8-ca00-4878-b447-73b1624b801e MY_CLONE 00:17:12.814 15:18:16 -- target/nvmf_lvol.sh@49 -- # clone=a9ad2244-7df7-4388-8806-b5cb08b7ae36 00:17:12.814 15:18:16 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate a9ad2244-7df7-4388-8806-b5cb08b7ae36 00:17:13.073 15:18:16 -- target/nvmf_lvol.sh@53 -- # wait 628575 00:17:23.051 Initializing NVMe Controllers 00:17:23.051 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:17:23.051 Controller IO queue size 128, less than required. 00:17:23.051 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:23.051 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:23.051 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:23.051 Initialization complete. Launching workers. 00:17:23.051 ======================================================== 00:17:23.051 Latency(us) 00:17:23.051 Device Information : IOPS MiB/s Average min max 00:17:23.051 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 17136.80 66.94 7471.34 2224.61 50146.72 00:17:23.051 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 17210.10 67.23 7438.64 2719.16 40230.42 00:17:23.051 ======================================================== 00:17:23.051 Total : 34346.90 134.17 7454.95 2224.61 50146.72 00:17:23.051 00:17:23.051 15:18:26 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:23.051 15:18:26 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a0c12683-d54a-4ee3-9cb8-384fae9d59c9 00:17:23.051 15:18:26 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 7ce3974a-6721-44f0-b8ef-a0fb00cf5ef7 00:17:23.310 15:18:27 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:23.310 15:18:27 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:23.310 15:18:27 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:23.310 15:18:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:23.310 15:18:27 -- nvmf/common.sh@117 -- # sync 00:17:23.310 15:18:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:23.310 15:18:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:23.310 15:18:27 -- nvmf/common.sh@120 -- # set +e 00:17:23.310 15:18:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:23.310 15:18:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:23.310 rmmod nvme_rdma 00:17:23.310 rmmod nvme_fabrics 00:17:23.310 15:18:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:23.310 15:18:27 -- nvmf/common.sh@124 -- # set -e 00:17:23.310 15:18:27 -- nvmf/common.sh@125 -- # return 0 00:17:23.310 15:18:27 -- nvmf/common.sh@478 -- # '[' -n 628187 ']' 00:17:23.310 15:18:27 -- nvmf/common.sh@479 -- # killprocess 628187 00:17:23.310 15:18:27 -- common/autotest_common.sh@936 -- # '[' -z 628187 ']' 00:17:23.310 15:18:27 -- common/autotest_common.sh@940 -- # kill -0 628187 00:17:23.310 15:18:27 -- common/autotest_common.sh@941 -- # uname 00:17:23.310 15:18:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:23.310 15:18:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 628187 00:17:23.310 15:18:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:23.310 15:18:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:23.310 15:18:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 628187' 00:17:23.310 killing process with pid 628187 00:17:23.310 15:18:27 -- common/autotest_common.sh@955 -- # kill 628187 00:17:23.310 15:18:27 -- common/autotest_common.sh@960 -- # wait 628187 00:17:23.310 [2024-04-24 15:18:27.168204] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:23.570 15:18:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:23.570 15:18:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:23.570 00:17:23.570 real 0m22.356s 00:17:23.570 user 1m11.210s 00:17:23.570 sys 0m6.711s 00:17:23.570 15:18:27 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:23.570 15:18:27 -- common/autotest_common.sh@10 -- # set +x 00:17:23.570 ************************************ 00:17:23.570 END TEST nvmf_lvol 00:17:23.570 ************************************ 00:17:23.828 15:18:27 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:23.828 15:18:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:23.828 15:18:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:23.828 15:18:27 -- common/autotest_common.sh@10 -- # set +x 00:17:23.828 ************************************ 00:17:23.828 START TEST nvmf_lvs_grow 00:17:23.828 ************************************ 00:17:23.829 15:18:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:24.088 * Looking for test storage... 00:17:24.088 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:17:24.088 15:18:27 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:17:24.088 15:18:27 -- nvmf/common.sh@7 -- # uname -s 00:17:24.088 15:18:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:24.088 15:18:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:24.088 15:18:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:24.088 15:18:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:24.088 15:18:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:24.088 15:18:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:24.088 15:18:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:24.088 15:18:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:24.088 15:18:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:24.088 15:18:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:24.088 15:18:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:17:24.088 15:18:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:17:24.088 15:18:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:24.088 15:18:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:24.088 15:18:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:24.088 15:18:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:24.088 15:18:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:17:24.088 15:18:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:24.088 15:18:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:24.088 15:18:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:24.088 15:18:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.088 15:18:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.088 15:18:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.088 15:18:27 -- paths/export.sh@5 -- # export PATH 00:17:24.088 15:18:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:24.088 15:18:27 -- nvmf/common.sh@47 -- # : 0 00:17:24.088 15:18:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:24.088 15:18:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:24.088 15:18:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:24.088 15:18:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:24.088 15:18:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:24.088 15:18:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:24.088 15:18:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:24.088 15:18:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:24.088 15:18:27 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:24.088 15:18:27 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:24.088 15:18:27 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:24.088 15:18:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:24.088 15:18:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:24.088 15:18:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:24.088 15:18:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:24.088 15:18:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:24.088 15:18:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:24.088 15:18:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:24.088 15:18:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:24.088 15:18:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:24.088 15:18:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:24.088 15:18:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:24.088 15:18:27 -- common/autotest_common.sh@10 -- # set +x 00:17:32.214 15:18:34 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:32.214 15:18:34 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:32.214 15:18:34 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:32.214 15:18:34 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:32.214 15:18:34 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:32.214 15:18:34 -- nvmf/common.sh@295 -- # net_devs=() 00:17:32.214 15:18:34 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@296 -- # e810=() 00:17:32.214 15:18:34 -- nvmf/common.sh@296 -- # local -ga e810 00:17:32.214 15:18:34 -- nvmf/common.sh@297 -- # x722=() 00:17:32.214 15:18:34 -- nvmf/common.sh@297 -- # local -ga x722 00:17:32.214 15:18:34 -- nvmf/common.sh@298 -- # mlx=() 00:17:32.214 15:18:34 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:32.214 15:18:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:32.214 15:18:34 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:17:32.214 Found 0000:18:00.0 (0x8086 - 0x1592) 00:17:32.214 15:18:34 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:32.214 15:18:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:17:32.214 Found 0000:18:00.1 (0x8086 - 0x1592) 00:17:32.214 15:18:34 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:32.214 15:18:34 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@377 -- # modinfo irdma 00:17:32.214 15:18:34 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:17:32.214 15:18:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.214 15:18:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.214 15:18:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:17:32.214 Found net devices under 0000:18:00.0: cvl_0_0 00:17:32.214 15:18:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.214 15:18:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.214 15:18:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:17:32.214 Found net devices under 0000:18:00.1: cvl_0_1 00:17:32.214 15:18:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.214 15:18:34 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:32.214 15:18:34 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:32.214 15:18:34 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:32.214 15:18:34 -- nvmf/common.sh@58 -- # uname 00:17:32.214 15:18:34 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:32.214 15:18:34 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:32.214 15:18:34 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:32.214 15:18:34 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:32.214 15:18:34 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:32.214 15:18:34 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:32.214 15:18:34 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:32.214 15:18:34 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:32.214 15:18:34 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:32.214 15:18:34 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:32.214 15:18:34 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:32.214 15:18:34 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:32.214 15:18:34 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:32.214 15:18:34 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:32.214 15:18:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:32.214 15:18:34 -- nvmf/common.sh@105 -- # continue 2 00:17:32.214 15:18:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.214 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:32.214 15:18:34 -- nvmf/common.sh@105 -- # continue 2 00:17:32.214 15:18:34 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:32.214 15:18:34 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:17:32.214 15:18:34 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.214 15:18:34 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:32.214 15:18:34 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:17:32.214 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:32.214 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:17:32.214 altname enp24s0f0np0 00:17:32.214 altname ens785f0np0 00:17:32.214 inet 192.168.100.8/24 scope global cvl_0_0 00:17:32.214 valid_lft forever preferred_lft forever 00:17:32.214 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:17:32.214 valid_lft forever preferred_lft forever 00:17:32.214 15:18:34 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:32.214 15:18:34 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:17:32.214 15:18:34 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.214 15:18:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.214 15:18:34 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:32.214 15:18:34 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:17:32.214 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:17:32.214 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:17:32.214 altname enp24s0f1np1 00:17:32.214 altname ens785f1np1 00:17:32.214 inet 192.168.100.9/24 scope global cvl_0_1 00:17:32.214 valid_lft forever preferred_lft forever 00:17:32.214 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:17:32.214 valid_lft forever preferred_lft forever 00:17:32.214 15:18:34 -- nvmf/common.sh@411 -- # return 0 00:17:32.214 15:18:34 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:32.214 15:18:34 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:32.214 15:18:34 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:32.214 15:18:34 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:32.214 15:18:34 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:32.214 15:18:34 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:32.214 15:18:34 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:32.214 15:18:34 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:32.215 15:18:34 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:32.215 15:18:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.215 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.215 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:17:32.215 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.215 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:17:32.215 15:18:34 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:17:32.215 15:18:34 -- nvmf/common.sh@105 -- # continue 2 00:17:32.215 15:18:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:32.215 15:18:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:32.215 15:18:34 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:17:32.215 15:18:34 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:17:32.215 15:18:34 -- nvmf/common.sh@105 -- # continue 2 00:17:32.215 15:18:34 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:32.215 15:18:34 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:17:32.215 15:18:34 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.215 15:18:34 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:32.215 15:18:34 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:17:32.215 15:18:34 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:32.215 15:18:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:32.215 15:18:34 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:32.215 192.168.100.9' 00:17:32.215 15:18:34 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:32.215 192.168.100.9' 00:17:32.215 15:18:34 -- nvmf/common.sh@446 -- # head -n 1 00:17:32.215 15:18:34 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:32.215 15:18:34 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:32.215 192.168.100.9' 00:17:32.215 15:18:34 -- nvmf/common.sh@447 -- # tail -n +2 00:17:32.215 15:18:34 -- nvmf/common.sh@447 -- # head -n 1 00:17:32.215 15:18:34 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:32.215 15:18:34 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:32.215 15:18:34 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:32.215 15:18:34 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:32.215 15:18:34 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:32.215 15:18:34 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:32.215 15:18:35 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:32.215 15:18:35 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:32.215 15:18:35 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:32.215 15:18:35 -- common/autotest_common.sh@10 -- # set +x 00:17:32.215 15:18:35 -- nvmf/common.sh@470 -- # nvmfpid=633525 00:17:32.215 15:18:35 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:32.215 15:18:35 -- nvmf/common.sh@471 -- # waitforlisten 633525 00:17:32.215 15:18:35 -- common/autotest_common.sh@817 -- # '[' -z 633525 ']' 00:17:32.215 15:18:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:32.215 15:18:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:32.215 15:18:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:32.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:32.215 15:18:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:32.215 15:18:35 -- common/autotest_common.sh@10 -- # set +x 00:17:32.215 [2024-04-24 15:18:35.074027] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:17:32.215 [2024-04-24 15:18:35.074084] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:32.215 EAL: No free 2048 kB hugepages reported on node 1 00:17:32.215 [2024-04-24 15:18:35.154811] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:32.215 [2024-04-24 15:18:35.235552] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:32.215 [2024-04-24 15:18:35.235599] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:32.215 [2024-04-24 15:18:35.235608] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:32.215 [2024-04-24 15:18:35.235616] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:32.215 [2024-04-24 15:18:35.235623] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:32.215 [2024-04-24 15:18:35.235647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:32.215 15:18:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:32.215 15:18:35 -- common/autotest_common.sh@850 -- # return 0 00:17:32.215 15:18:35 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:32.215 15:18:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:32.215 15:18:35 -- common/autotest_common.sh@10 -- # set +x 00:17:32.215 15:18:35 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:32.215 15:18:35 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:32.215 [2024-04-24 15:18:36.087400] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x5b2800/0x5b1e40) succeed. 00:17:32.215 [2024-04-24 15:18:36.096829] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x5b3ab0/0x5b23c0) succeed. 00:17:32.215 [2024-04-24 15:18:36.096857] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:17:32.215 15:18:36 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:32.215 15:18:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:32.215 15:18:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:32.215 15:18:36 -- common/autotest_common.sh@10 -- # set +x 00:17:32.475 ************************************ 00:17:32.475 START TEST lvs_grow_clean 00:17:32.475 ************************************ 00:17:32.475 15:18:36 -- common/autotest_common.sh@1111 -- # lvs_grow 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.475 15:18:36 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:32.734 15:18:36 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:32.734 15:18:36 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@28 -- # lvs=b4e0987c-40f1-4676-a31d-bd5391043527 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:32.992 15:18:36 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b4e0987c-40f1-4676-a31d-bd5391043527 lvol 150 00:17:33.251 15:18:37 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b254f1d1-c6c5-4122-8869-f054083c6629 00:17:33.251 15:18:37 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.251 15:18:37 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:33.510 [2024-04-24 15:18:37.171174] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:33.510 [2024-04-24 15:18:37.171233] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:33.510 true 00:17:33.510 15:18:37 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:33.510 15:18:37 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:33.510 15:18:37 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:33.510 15:18:37 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:33.769 15:18:37 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b254f1d1-c6c5-4122-8869-f054083c6629 00:17:34.028 15:18:37 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:34.028 [2024-04-24 15:18:37.841119] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:34.029 15:18:37 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:34.289 15:18:38 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=633927 00:17:34.289 15:18:38 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:34.289 15:18:38 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 633927 /var/tmp/bdevperf.sock 00:17:34.289 15:18:38 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:34.289 15:18:38 -- common/autotest_common.sh@817 -- # '[' -z 633927 ']' 00:17:34.289 15:18:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:34.289 15:18:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:34.289 15:18:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:34.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:34.289 15:18:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:34.289 15:18:38 -- common/autotest_common.sh@10 -- # set +x 00:17:34.289 [2024-04-24 15:18:38.059633] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:17:34.289 [2024-04-24 15:18:38.059694] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid633927 ] 00:17:34.289 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.289 [2024-04-24 15:18:38.138496] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.548 [2024-04-24 15:18:38.215987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:35.117 15:18:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:35.117 15:18:38 -- common/autotest_common.sh@850 -- # return 0 00:17:35.117 15:18:38 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:35.377 Nvme0n1 00:17:35.377 15:18:39 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:35.377 [ 00:17:35.377 { 00:17:35.377 "name": "Nvme0n1", 00:17:35.377 "aliases": [ 00:17:35.377 "b254f1d1-c6c5-4122-8869-f054083c6629" 00:17:35.377 ], 00:17:35.377 "product_name": "NVMe disk", 00:17:35.377 "block_size": 4096, 00:17:35.377 "num_blocks": 38912, 00:17:35.377 "uuid": "b254f1d1-c6c5-4122-8869-f054083c6629", 00:17:35.377 "assigned_rate_limits": { 00:17:35.377 "rw_ios_per_sec": 0, 00:17:35.377 "rw_mbytes_per_sec": 0, 00:17:35.377 "r_mbytes_per_sec": 0, 00:17:35.377 "w_mbytes_per_sec": 0 00:17:35.377 }, 00:17:35.377 "claimed": false, 00:17:35.377 "zoned": false, 00:17:35.377 "supported_io_types": { 00:17:35.377 "read": true, 00:17:35.377 "write": true, 00:17:35.377 "unmap": true, 00:17:35.377 "write_zeroes": true, 00:17:35.377 "flush": true, 00:17:35.377 "reset": true, 00:17:35.377 "compare": true, 00:17:35.377 "compare_and_write": true, 00:17:35.377 "abort": true, 00:17:35.377 "nvme_admin": true, 00:17:35.377 "nvme_io": true 00:17:35.377 }, 00:17:35.377 "memory_domains": [ 00:17:35.377 { 00:17:35.377 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:35.377 "dma_device_type": 0 00:17:35.377 } 00:17:35.377 ], 00:17:35.377 "driver_specific": { 00:17:35.377 "nvme": [ 00:17:35.377 { 00:17:35.377 "trid": { 00:17:35.377 "trtype": "RDMA", 00:17:35.377 "adrfam": "IPv4", 00:17:35.377 "traddr": "192.168.100.8", 00:17:35.377 "trsvcid": "4420", 00:17:35.377 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:35.377 }, 00:17:35.377 "ctrlr_data": { 00:17:35.377 "cntlid": 1, 00:17:35.377 "vendor_id": "0x8086", 00:17:35.377 "model_number": "SPDK bdev Controller", 00:17:35.377 "serial_number": "SPDK0", 00:17:35.377 "firmware_revision": "24.05", 00:17:35.377 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:35.377 "oacs": { 00:17:35.377 "security": 0, 00:17:35.377 "format": 0, 00:17:35.377 "firmware": 0, 00:17:35.377 "ns_manage": 0 00:17:35.377 }, 00:17:35.377 "multi_ctrlr": true, 00:17:35.377 "ana_reporting": false 00:17:35.377 }, 00:17:35.377 "vs": { 00:17:35.377 "nvme_version": "1.3" 00:17:35.377 }, 00:17:35.377 "ns_data": { 00:17:35.377 "id": 1, 00:17:35.377 "can_share": true 00:17:35.377 } 00:17:35.377 } 00:17:35.377 ], 00:17:35.377 "mp_policy": "active_passive" 00:17:35.377 } 00:17:35.377 } 00:17:35.377 ] 00:17:35.377 15:18:39 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=634106 00:17:35.377 15:18:39 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:35.377 15:18:39 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:35.636 Running I/O for 10 seconds... 00:17:36.571 Latency(us) 00:17:36.571 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.571 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.571 Nvme0n1 : 1.00 35290.00 137.85 0.00 0.00 0.00 0.00 0.00 00:17:36.571 =================================================================================================================== 00:17:36.571 Total : 35290.00 137.85 0.00 0.00 0.00 0.00 0.00 00:17:36.571 00:17:37.505 15:18:41 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:37.505 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.505 Nvme0n1 : 2.00 35732.00 139.58 0.00 0.00 0.00 0.00 0.00 00:17:37.505 =================================================================================================================== 00:17:37.505 Total : 35732.00 139.58 0.00 0.00 0.00 0.00 0.00 00:17:37.505 00:17:37.797 true 00:17:37.797 15:18:41 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:37.797 15:18:41 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:37.797 15:18:41 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:37.797 15:18:41 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:37.797 15:18:41 -- target/nvmf_lvs_grow.sh@65 -- # wait 634106 00:17:38.731 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.731 Nvme0n1 : 3.00 35933.67 140.37 0.00 0.00 0.00 0.00 0.00 00:17:38.731 =================================================================================================================== 00:17:38.731 Total : 35933.67 140.37 0.00 0.00 0.00 0.00 0.00 00:17:38.731 00:17:39.667 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.667 Nvme0n1 : 4.00 36161.75 141.26 0.00 0.00 0.00 0.00 0.00 00:17:39.667 =================================================================================================================== 00:17:39.667 Total : 36161.75 141.26 0.00 0.00 0.00 0.00 0.00 00:17:39.667 00:17:40.604 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.604 Nvme0n1 : 5.00 36296.20 141.78 0.00 0.00 0.00 0.00 0.00 00:17:40.604 =================================================================================================================== 00:17:40.604 Total : 36296.20 141.78 0.00 0.00 0.00 0.00 0.00 00:17:40.604 00:17:41.540 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.540 Nvme0n1 : 6.00 36404.00 142.20 0.00 0.00 0.00 0.00 0.00 00:17:41.540 =================================================================================================================== 00:17:41.540 Total : 36404.00 142.20 0.00 0.00 0.00 0.00 0.00 00:17:41.540 00:17:42.476 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.476 Nvme0n1 : 7.00 36483.57 142.51 0.00 0.00 0.00 0.00 0.00 00:17:42.476 =================================================================================================================== 00:17:42.476 Total : 36483.57 142.51 0.00 0.00 0.00 0.00 0.00 00:17:42.476 00:17:43.854 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.854 Nvme0n1 : 8.00 36503.00 142.59 0.00 0.00 0.00 0.00 0.00 00:17:43.854 =================================================================================================================== 00:17:43.854 Total : 36503.00 142.59 0.00 0.00 0.00 0.00 0.00 00:17:43.854 00:17:44.790 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.790 Nvme0n1 : 9.00 36546.67 142.76 0.00 0.00 0.00 0.00 0.00 00:17:44.790 =================================================================================================================== 00:17:44.790 Total : 36546.67 142.76 0.00 0.00 0.00 0.00 0.00 00:17:44.790 00:17:45.725 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.725 Nvme0n1 : 10.00 36594.20 142.95 0.00 0.00 0.00 0.00 0.00 00:17:45.725 =================================================================================================================== 00:17:45.725 Total : 36594.20 142.95 0.00 0.00 0.00 0.00 0.00 00:17:45.725 00:17:45.725 00:17:45.725 Latency(us) 00:17:45.725 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.725 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.725 Nvme0n1 : 10.00 36594.82 142.95 0.00 0.00 3494.97 2450.48 12993.22 00:17:45.725 =================================================================================================================== 00:17:45.725 Total : 36594.82 142.95 0.00 0.00 3494.97 2450.48 12993.22 00:17:45.725 0 00:17:45.725 15:18:49 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 633927 00:17:45.725 15:18:49 -- common/autotest_common.sh@936 -- # '[' -z 633927 ']' 00:17:45.725 15:18:49 -- common/autotest_common.sh@940 -- # kill -0 633927 00:17:45.725 15:18:49 -- common/autotest_common.sh@941 -- # uname 00:17:45.725 15:18:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:45.725 15:18:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 633927 00:17:45.725 15:18:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:45.725 15:18:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:45.725 15:18:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 633927' 00:17:45.725 killing process with pid 633927 00:17:45.725 15:18:49 -- common/autotest_common.sh@955 -- # kill 633927 00:17:45.725 Received shutdown signal, test time was about 10.000000 seconds 00:17:45.725 00:17:45.725 Latency(us) 00:17:45.725 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.725 =================================================================================================================== 00:17:45.725 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:45.725 15:18:49 -- common/autotest_common.sh@960 -- # wait 633927 00:17:45.983 15:18:49 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:45.983 15:18:49 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:45.983 15:18:49 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:46.242 15:18:50 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:46.242 15:18:50 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:46.242 15:18:50 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:46.500 [2024-04-24 15:18:50.217328] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:46.500 15:18:50 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:46.500 15:18:50 -- common/autotest_common.sh@638 -- # local es=0 00:17:46.500 15:18:50 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:46.500 15:18:50 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:46.500 15:18:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:46.500 15:18:50 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:46.500 15:18:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:46.500 15:18:50 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:46.500 15:18:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:46.501 15:18:50 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:17:46.501 15:18:50 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:17:46.501 15:18:50 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:46.764 request: 00:17:46.764 { 00:17:46.764 "uuid": "b4e0987c-40f1-4676-a31d-bd5391043527", 00:17:46.764 "method": "bdev_lvol_get_lvstores", 00:17:46.764 "req_id": 1 00:17:46.764 } 00:17:46.764 Got JSON-RPC error response 00:17:46.764 response: 00:17:46.764 { 00:17:46.764 "code": -19, 00:17:46.764 "message": "No such device" 00:17:46.764 } 00:17:46.764 15:18:50 -- common/autotest_common.sh@641 -- # es=1 00:17:46.764 15:18:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:46.764 15:18:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:46.764 15:18:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:46.764 15:18:50 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:46.764 aio_bdev 00:17:46.764 15:18:50 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b254f1d1-c6c5-4122-8869-f054083c6629 00:17:46.765 15:18:50 -- common/autotest_common.sh@885 -- # local bdev_name=b254f1d1-c6c5-4122-8869-f054083c6629 00:17:46.765 15:18:50 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:17:46.765 15:18:50 -- common/autotest_common.sh@887 -- # local i 00:17:46.765 15:18:50 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:17:46.765 15:18:50 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:17:46.765 15:18:50 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:47.033 15:18:50 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b254f1d1-c6c5-4122-8869-f054083c6629 -t 2000 00:17:47.033 [ 00:17:47.033 { 00:17:47.033 "name": "b254f1d1-c6c5-4122-8869-f054083c6629", 00:17:47.033 "aliases": [ 00:17:47.033 "lvs/lvol" 00:17:47.033 ], 00:17:47.033 "product_name": "Logical Volume", 00:17:47.033 "block_size": 4096, 00:17:47.033 "num_blocks": 38912, 00:17:47.033 "uuid": "b254f1d1-c6c5-4122-8869-f054083c6629", 00:17:47.033 "assigned_rate_limits": { 00:17:47.033 "rw_ios_per_sec": 0, 00:17:47.033 "rw_mbytes_per_sec": 0, 00:17:47.033 "r_mbytes_per_sec": 0, 00:17:47.033 "w_mbytes_per_sec": 0 00:17:47.033 }, 00:17:47.033 "claimed": false, 00:17:47.033 "zoned": false, 00:17:47.033 "supported_io_types": { 00:17:47.033 "read": true, 00:17:47.033 "write": true, 00:17:47.033 "unmap": true, 00:17:47.033 "write_zeroes": true, 00:17:47.033 "flush": false, 00:17:47.033 "reset": true, 00:17:47.033 "compare": false, 00:17:47.033 "compare_and_write": false, 00:17:47.033 "abort": false, 00:17:47.033 "nvme_admin": false, 00:17:47.033 "nvme_io": false 00:17:47.033 }, 00:17:47.033 "driver_specific": { 00:17:47.033 "lvol": { 00:17:47.033 "lvol_store_uuid": "b4e0987c-40f1-4676-a31d-bd5391043527", 00:17:47.033 "base_bdev": "aio_bdev", 00:17:47.033 "thin_provision": false, 00:17:47.033 "snapshot": false, 00:17:47.033 "clone": false, 00:17:47.033 "esnap_clone": false 00:17:47.033 } 00:17:47.033 } 00:17:47.033 } 00:17:47.033 ] 00:17:47.033 15:18:50 -- common/autotest_common.sh@893 -- # return 0 00:17:47.033 15:18:50 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:47.033 15:18:50 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:47.291 15:18:51 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:47.291 15:18:51 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:47.291 15:18:51 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:47.550 15:18:51 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:47.550 15:18:51 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b254f1d1-c6c5-4122-8869-f054083c6629 00:17:47.550 15:18:51 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b4e0987c-40f1-4676-a31d-bd5391043527 00:17:47.808 15:18:51 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.067 00:17:48.067 real 0m15.519s 00:17:48.067 user 0m15.363s 00:17:48.067 sys 0m1.249s 00:17:48.067 15:18:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:48.067 15:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:48.067 ************************************ 00:17:48.067 END TEST lvs_grow_clean 00:17:48.067 ************************************ 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:48.067 15:18:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:48.067 15:18:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:48.067 15:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:48.067 ************************************ 00:17:48.067 START TEST lvs_grow_dirty 00:17:48.067 ************************************ 00:17:48.067 15:18:51 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.067 15:18:51 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:48.326 15:18:52 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:48.326 15:18:52 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:48.585 15:18:52 -- target/nvmf_lvs_grow.sh@28 -- # lvs=8e9ad26e-4fef-464a-844a-4a5a9031137b 00:17:48.585 15:18:52 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:17:48.585 15:18:52 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:48.843 15:18:52 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:48.843 15:18:52 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:48.844 15:18:52 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8e9ad26e-4fef-464a-844a-4a5a9031137b lvol 150 00:17:48.844 15:18:52 -- target/nvmf_lvs_grow.sh@33 -- # lvol=20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:17:48.844 15:18:52 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:48.844 15:18:52 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:49.103 [2024-04-24 15:18:52.852934] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:49.103 [2024-04-24 15:18:52.853001] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:49.103 true 00:17:49.103 15:18:52 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:17:49.103 15:18:52 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:49.361 15:18:53 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:49.361 15:18:53 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:49.361 15:18:53 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:17:49.620 15:18:53 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:49.620 15:18:53 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:49.879 15:18:53 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=636020 00:17:49.879 15:18:53 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:49.879 15:18:53 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 636020 /var/tmp/bdevperf.sock 00:17:49.879 15:18:53 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:49.879 15:18:53 -- common/autotest_common.sh@817 -- # '[' -z 636020 ']' 00:17:49.879 15:18:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.879 15:18:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:49.879 15:18:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.879 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.879 15:18:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:49.879 15:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:49.879 [2024-04-24 15:18:53.716533] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:17:49.879 [2024-04-24 15:18:53.716593] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid636020 ] 00:17:49.879 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.138 [2024-04-24 15:18:53.796873] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.138 [2024-04-24 15:18:53.876751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:50.705 15:18:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:50.705 15:18:54 -- common/autotest_common.sh@850 -- # return 0 00:17:50.705 15:18:54 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:50.964 Nvme0n1 00:17:50.964 15:18:54 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:51.222 [ 00:17:51.222 { 00:17:51.222 "name": "Nvme0n1", 00:17:51.222 "aliases": [ 00:17:51.222 "20d6f4fe-89c6-43b1-88fb-7060a4b8415d" 00:17:51.222 ], 00:17:51.222 "product_name": "NVMe disk", 00:17:51.222 "block_size": 4096, 00:17:51.222 "num_blocks": 38912, 00:17:51.222 "uuid": "20d6f4fe-89c6-43b1-88fb-7060a4b8415d", 00:17:51.222 "assigned_rate_limits": { 00:17:51.222 "rw_ios_per_sec": 0, 00:17:51.222 "rw_mbytes_per_sec": 0, 00:17:51.222 "r_mbytes_per_sec": 0, 00:17:51.222 "w_mbytes_per_sec": 0 00:17:51.222 }, 00:17:51.222 "claimed": false, 00:17:51.222 "zoned": false, 00:17:51.222 "supported_io_types": { 00:17:51.222 "read": true, 00:17:51.222 "write": true, 00:17:51.222 "unmap": true, 00:17:51.222 "write_zeroes": true, 00:17:51.222 "flush": true, 00:17:51.222 "reset": true, 00:17:51.222 "compare": true, 00:17:51.223 "compare_and_write": true, 00:17:51.223 "abort": true, 00:17:51.223 "nvme_admin": true, 00:17:51.223 "nvme_io": true 00:17:51.223 }, 00:17:51.223 "memory_domains": [ 00:17:51.223 { 00:17:51.223 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:51.223 "dma_device_type": 0 00:17:51.223 } 00:17:51.223 ], 00:17:51.223 "driver_specific": { 00:17:51.223 "nvme": [ 00:17:51.223 { 00:17:51.223 "trid": { 00:17:51.223 "trtype": "RDMA", 00:17:51.223 "adrfam": "IPv4", 00:17:51.223 "traddr": "192.168.100.8", 00:17:51.223 "trsvcid": "4420", 00:17:51.223 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:51.223 }, 00:17:51.223 "ctrlr_data": { 00:17:51.223 "cntlid": 1, 00:17:51.223 "vendor_id": "0x8086", 00:17:51.223 "model_number": "SPDK bdev Controller", 00:17:51.223 "serial_number": "SPDK0", 00:17:51.223 "firmware_revision": "24.05", 00:17:51.223 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:51.223 "oacs": { 00:17:51.223 "security": 0, 00:17:51.223 "format": 0, 00:17:51.223 "firmware": 0, 00:17:51.223 "ns_manage": 0 00:17:51.223 }, 00:17:51.223 "multi_ctrlr": true, 00:17:51.223 "ana_reporting": false 00:17:51.223 }, 00:17:51.223 "vs": { 00:17:51.223 "nvme_version": "1.3" 00:17:51.223 }, 00:17:51.223 "ns_data": { 00:17:51.223 "id": 1, 00:17:51.223 "can_share": true 00:17:51.223 } 00:17:51.223 } 00:17:51.223 ], 00:17:51.223 "mp_policy": "active_passive" 00:17:51.223 } 00:17:51.223 } 00:17:51.223 ] 00:17:51.223 15:18:54 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=636164 00:17:51.223 15:18:54 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:51.223 15:18:54 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:51.223 Running I/O for 10 seconds... 00:17:52.159 Latency(us) 00:17:52.159 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.159 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:52.159 Nvme0n1 : 1.00 35815.00 139.90 0.00 0.00 0.00 0.00 0.00 00:17:52.159 =================================================================================================================== 00:17:52.159 Total : 35815.00 139.90 0.00 0.00 0.00 0.00 0.00 00:17:52.159 00:17:53.095 15:18:56 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:17:53.354 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:53.354 Nvme0n1 : 2.00 36061.50 140.87 0.00 0.00 0.00 0.00 0.00 00:17:53.354 =================================================================================================================== 00:17:53.354 Total : 36061.50 140.87 0.00 0.00 0.00 0.00 0.00 00:17:53.354 00:17:53.354 true 00:17:53.354 15:18:57 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:17:53.354 15:18:57 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:53.613 15:18:57 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:53.613 15:18:57 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:53.613 15:18:57 -- target/nvmf_lvs_grow.sh@65 -- # wait 636164 00:17:54.181 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:54.181 Nvme0n1 : 3.00 36211.67 141.45 0.00 0.00 0.00 0.00 0.00 00:17:54.181 =================================================================================================================== 00:17:54.181 Total : 36211.67 141.45 0.00 0.00 0.00 0.00 0.00 00:17:54.181 00:17:55.560 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.560 Nvme0n1 : 4.00 36369.50 142.07 0.00 0.00 0.00 0.00 0.00 00:17:55.561 =================================================================================================================== 00:17:55.561 Total : 36369.50 142.07 0.00 0.00 0.00 0.00 0.00 00:17:55.561 00:17:56.498 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.498 Nvme0n1 : 5.00 36453.40 142.40 0.00 0.00 0.00 0.00 0.00 00:17:56.498 =================================================================================================================== 00:17:56.498 Total : 36453.40 142.40 0.00 0.00 0.00 0.00 0.00 00:17:56.498 00:17:57.435 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.435 Nvme0n1 : 6.00 36383.00 142.12 0.00 0.00 0.00 0.00 0.00 00:17:57.435 =================================================================================================================== 00:17:57.435 Total : 36383.00 142.12 0.00 0.00 0.00 0.00 0.00 00:17:57.435 00:17:58.371 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.371 Nvme0n1 : 7.00 36435.43 142.33 0.00 0.00 0.00 0.00 0.00 00:17:58.371 =================================================================================================================== 00:17:58.371 Total : 36435.43 142.33 0.00 0.00 0.00 0.00 0.00 00:17:58.371 00:17:59.307 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.307 Nvme0n1 : 8.00 36495.25 142.56 0.00 0.00 0.00 0.00 0.00 00:17:59.307 =================================================================================================================== 00:17:59.307 Total : 36495.25 142.56 0.00 0.00 0.00 0.00 0.00 00:17:59.307 00:18:00.241 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.241 Nvme0n1 : 9.00 36544.67 142.75 0.00 0.00 0.00 0.00 0.00 00:18:00.241 =================================================================================================================== 00:18:00.241 Total : 36544.67 142.75 0.00 0.00 0.00 0.00 0.00 00:18:00.241 00:18:01.177 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.177 Nvme0n1 : 10.00 36509.50 142.62 0.00 0.00 0.00 0.00 0.00 00:18:01.177 =================================================================================================================== 00:18:01.177 Total : 36509.50 142.62 0.00 0.00 0.00 0.00 0.00 00:18:01.177 00:18:01.177 00:18:01.177 Latency(us) 00:18:01.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.177 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.177 Nvme0n1 : 10.00 36509.87 142.62 0.00 0.00 3503.07 2649.93 15044.79 00:18:01.177 =================================================================================================================== 00:18:01.177 Total : 36509.87 142.62 0.00 0.00 3503.07 2649.93 15044.79 00:18:01.177 0 00:18:01.177 15:19:05 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 636020 00:18:01.177 15:19:05 -- common/autotest_common.sh@936 -- # '[' -z 636020 ']' 00:18:01.177 15:19:05 -- common/autotest_common.sh@940 -- # kill -0 636020 00:18:01.177 15:19:05 -- common/autotest_common.sh@941 -- # uname 00:18:01.177 15:19:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:01.177 15:19:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 636020 00:18:01.436 15:19:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:01.436 15:19:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:01.436 15:19:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 636020' 00:18:01.436 killing process with pid 636020 00:18:01.436 15:19:05 -- common/autotest_common.sh@955 -- # kill 636020 00:18:01.436 Received shutdown signal, test time was about 10.000000 seconds 00:18:01.436 00:18:01.436 Latency(us) 00:18:01.436 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.436 =================================================================================================================== 00:18:01.436 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:01.436 15:19:05 -- common/autotest_common.sh@960 -- # wait 636020 00:18:01.697 15:19:05 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:01.697 15:19:05 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:01.697 15:19:05 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:02.017 15:19:05 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:02.018 15:19:05 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:02.018 15:19:05 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 633525 00:18:02.018 15:19:05 -- target/nvmf_lvs_grow.sh@74 -- # wait 633525 00:18:02.018 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 633525 Killed "${NVMF_APP[@]}" "$@" 00:18:02.018 15:19:05 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:02.018 15:19:05 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:02.018 15:19:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:02.018 15:19:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:02.018 15:19:05 -- common/autotest_common.sh@10 -- # set +x 00:18:02.018 15:19:05 -- nvmf/common.sh@470 -- # nvmfpid=637537 00:18:02.018 15:19:05 -- nvmf/common.sh@471 -- # waitforlisten 637537 00:18:02.018 15:19:05 -- common/autotest_common.sh@817 -- # '[' -z 637537 ']' 00:18:02.018 15:19:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.018 15:19:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:02.018 15:19:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.018 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.018 15:19:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:02.018 15:19:05 -- common/autotest_common.sh@10 -- # set +x 00:18:02.018 15:19:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:02.018 [2024-04-24 15:19:05.800796] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:02.018 [2024-04-24 15:19:05.800862] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.018 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.018 [2024-04-24 15:19:05.883649] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.299 [2024-04-24 15:19:05.970390] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:02.299 [2024-04-24 15:19:05.970437] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:02.299 [2024-04-24 15:19:05.970446] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:02.299 [2024-04-24 15:19:05.970454] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:02.299 [2024-04-24 15:19:05.970461] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:02.299 [2024-04-24 15:19:05.970497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:02.893 15:19:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:02.893 15:19:06 -- common/autotest_common.sh@850 -- # return 0 00:18:02.893 15:19:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:02.893 15:19:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:02.893 15:19:06 -- common/autotest_common.sh@10 -- # set +x 00:18:02.893 15:19:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:02.893 15:19:06 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:02.893 [2024-04-24 15:19:06.789744] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:02.893 [2024-04-24 15:19:06.789831] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:02.893 [2024-04-24 15:19:06.789858] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:03.152 15:19:06 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:03.152 15:19:06 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:18:03.152 15:19:06 -- common/autotest_common.sh@885 -- # local bdev_name=20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:18:03.152 15:19:06 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:03.152 15:19:06 -- common/autotest_common.sh@887 -- # local i 00:18:03.152 15:19:06 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:03.152 15:19:06 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:03.152 15:19:06 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:03.152 15:19:06 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 20d6f4fe-89c6-43b1-88fb-7060a4b8415d -t 2000 00:18:03.410 [ 00:18:03.410 { 00:18:03.410 "name": "20d6f4fe-89c6-43b1-88fb-7060a4b8415d", 00:18:03.410 "aliases": [ 00:18:03.410 "lvs/lvol" 00:18:03.410 ], 00:18:03.410 "product_name": "Logical Volume", 00:18:03.410 "block_size": 4096, 00:18:03.410 "num_blocks": 38912, 00:18:03.410 "uuid": "20d6f4fe-89c6-43b1-88fb-7060a4b8415d", 00:18:03.410 "assigned_rate_limits": { 00:18:03.410 "rw_ios_per_sec": 0, 00:18:03.410 "rw_mbytes_per_sec": 0, 00:18:03.411 "r_mbytes_per_sec": 0, 00:18:03.411 "w_mbytes_per_sec": 0 00:18:03.411 }, 00:18:03.411 "claimed": false, 00:18:03.411 "zoned": false, 00:18:03.411 "supported_io_types": { 00:18:03.411 "read": true, 00:18:03.411 "write": true, 00:18:03.411 "unmap": true, 00:18:03.411 "write_zeroes": true, 00:18:03.411 "flush": false, 00:18:03.411 "reset": true, 00:18:03.411 "compare": false, 00:18:03.411 "compare_and_write": false, 00:18:03.411 "abort": false, 00:18:03.411 "nvme_admin": false, 00:18:03.411 "nvme_io": false 00:18:03.411 }, 00:18:03.411 "driver_specific": { 00:18:03.411 "lvol": { 00:18:03.411 "lvol_store_uuid": "8e9ad26e-4fef-464a-844a-4a5a9031137b", 00:18:03.411 "base_bdev": "aio_bdev", 00:18:03.411 "thin_provision": false, 00:18:03.411 "snapshot": false, 00:18:03.411 "clone": false, 00:18:03.411 "esnap_clone": false 00:18:03.411 } 00:18:03.411 } 00:18:03.411 } 00:18:03.411 ] 00:18:03.411 15:19:07 -- common/autotest_common.sh@893 -- # return 0 00:18:03.411 15:19:07 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:03.411 15:19:07 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:03.669 15:19:07 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:03.669 15:19:07 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:03.669 15:19:07 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:03.669 15:19:07 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:03.669 15:19:07 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:03.928 [2024-04-24 15:19:07.658018] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:03.928 15:19:07 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:03.928 15:19:07 -- common/autotest_common.sh@638 -- # local es=0 00:18:03.928 15:19:07 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:03.928 15:19:07 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:18:03.928 15:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:03.928 15:19:07 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:18:03.928 15:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:03.928 15:19:07 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:18:03.928 15:19:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:03.928 15:19:07 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:18:03.928 15:19:07 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py ]] 00:18:03.928 15:19:07 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:04.187 request: 00:18:04.187 { 00:18:04.187 "uuid": "8e9ad26e-4fef-464a-844a-4a5a9031137b", 00:18:04.187 "method": "bdev_lvol_get_lvstores", 00:18:04.187 "req_id": 1 00:18:04.187 } 00:18:04.187 Got JSON-RPC error response 00:18:04.187 response: 00:18:04.187 { 00:18:04.187 "code": -19, 00:18:04.187 "message": "No such device" 00:18:04.187 } 00:18:04.187 15:19:07 -- common/autotest_common.sh@641 -- # es=1 00:18:04.187 15:19:07 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:18:04.187 15:19:07 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:18:04.187 15:19:07 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:18:04.187 15:19:07 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:04.187 aio_bdev 00:18:04.187 15:19:08 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:18:04.187 15:19:08 -- common/autotest_common.sh@885 -- # local bdev_name=20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:18:04.187 15:19:08 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:04.187 15:19:08 -- common/autotest_common.sh@887 -- # local i 00:18:04.187 15:19:08 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:04.187 15:19:08 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:04.187 15:19:08 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:04.446 15:19:08 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 20d6f4fe-89c6-43b1-88fb-7060a4b8415d -t 2000 00:18:04.704 [ 00:18:04.704 { 00:18:04.704 "name": "20d6f4fe-89c6-43b1-88fb-7060a4b8415d", 00:18:04.704 "aliases": [ 00:18:04.704 "lvs/lvol" 00:18:04.704 ], 00:18:04.704 "product_name": "Logical Volume", 00:18:04.704 "block_size": 4096, 00:18:04.704 "num_blocks": 38912, 00:18:04.704 "uuid": "20d6f4fe-89c6-43b1-88fb-7060a4b8415d", 00:18:04.704 "assigned_rate_limits": { 00:18:04.704 "rw_ios_per_sec": 0, 00:18:04.704 "rw_mbytes_per_sec": 0, 00:18:04.704 "r_mbytes_per_sec": 0, 00:18:04.704 "w_mbytes_per_sec": 0 00:18:04.704 }, 00:18:04.704 "claimed": false, 00:18:04.704 "zoned": false, 00:18:04.704 "supported_io_types": { 00:18:04.704 "read": true, 00:18:04.704 "write": true, 00:18:04.704 "unmap": true, 00:18:04.704 "write_zeroes": true, 00:18:04.704 "flush": false, 00:18:04.704 "reset": true, 00:18:04.704 "compare": false, 00:18:04.704 "compare_and_write": false, 00:18:04.704 "abort": false, 00:18:04.704 "nvme_admin": false, 00:18:04.704 "nvme_io": false 00:18:04.704 }, 00:18:04.704 "driver_specific": { 00:18:04.704 "lvol": { 00:18:04.704 "lvol_store_uuid": "8e9ad26e-4fef-464a-844a-4a5a9031137b", 00:18:04.704 "base_bdev": "aio_bdev", 00:18:04.704 "thin_provision": false, 00:18:04.704 "snapshot": false, 00:18:04.704 "clone": false, 00:18:04.704 "esnap_clone": false 00:18:04.704 } 00:18:04.704 } 00:18:04.704 } 00:18:04.704 ] 00:18:04.704 15:19:08 -- common/autotest_common.sh@893 -- # return 0 00:18:04.704 15:19:08 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:04.704 15:19:08 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:04.704 15:19:08 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:04.704 15:19:08 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:04.704 15:19:08 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:04.963 15:19:08 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:04.963 15:19:08 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 20d6f4fe-89c6-43b1-88fb-7060a4b8415d 00:18:05.222 15:19:08 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8e9ad26e-4fef-464a-844a-4a5a9031137b 00:18:05.222 15:19:09 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:05.481 15:19:09 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:05.481 00:18:05.481 real 0m17.287s 00:18:05.481 user 0m45.019s 00:18:05.481 sys 0m3.303s 00:18:05.481 15:19:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:05.481 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:05.481 ************************************ 00:18:05.481 END TEST lvs_grow_dirty 00:18:05.481 ************************************ 00:18:05.481 15:19:09 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:05.481 15:19:09 -- common/autotest_common.sh@794 -- # type=--id 00:18:05.481 15:19:09 -- common/autotest_common.sh@795 -- # id=0 00:18:05.481 15:19:09 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:18:05.481 15:19:09 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:05.481 15:19:09 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:18:05.481 15:19:09 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:18:05.481 15:19:09 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:18:05.481 15:19:09 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:05.481 nvmf_trace.0 00:18:05.481 15:19:09 -- common/autotest_common.sh@809 -- # return 0 00:18:05.481 15:19:09 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:05.481 15:19:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:05.481 15:19:09 -- nvmf/common.sh@117 -- # sync 00:18:05.481 15:19:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:05.481 15:19:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:05.481 15:19:09 -- nvmf/common.sh@120 -- # set +e 00:18:05.481 15:19:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:05.481 15:19:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:05.481 rmmod nvme_rdma 00:18:05.481 rmmod nvme_fabrics 00:18:05.481 15:19:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:05.481 15:19:09 -- nvmf/common.sh@124 -- # set -e 00:18:05.481 15:19:09 -- nvmf/common.sh@125 -- # return 0 00:18:05.481 15:19:09 -- nvmf/common.sh@478 -- # '[' -n 637537 ']' 00:18:05.481 15:19:09 -- nvmf/common.sh@479 -- # killprocess 637537 00:18:05.481 15:19:09 -- common/autotest_common.sh@936 -- # '[' -z 637537 ']' 00:18:05.481 15:19:09 -- common/autotest_common.sh@940 -- # kill -0 637537 00:18:05.481 15:19:09 -- common/autotest_common.sh@941 -- # uname 00:18:05.740 15:19:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:05.740 15:19:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 637537 00:18:05.740 15:19:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:05.740 15:19:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:05.740 15:19:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 637537' 00:18:05.740 killing process with pid 637537 00:18:05.740 15:19:09 -- common/autotest_common.sh@955 -- # kill 637537 00:18:05.740 15:19:09 -- common/autotest_common.sh@960 -- # wait 637537 00:18:05.740 15:19:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:05.740 15:19:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:05.740 00:18:05.740 real 0m41.997s 00:18:05.740 user 1m6.769s 00:18:05.740 sys 0m10.654s 00:18:05.740 15:19:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:05.740 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:05.740 ************************************ 00:18:05.740 END TEST nvmf_lvs_grow 00:18:05.740 ************************************ 00:18:05.999 15:19:09 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:05.999 15:19:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:05.999 15:19:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:05.999 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:05.999 ************************************ 00:18:05.999 START TEST nvmf_bdev_io_wait 00:18:05.999 ************************************ 00:18:05.999 15:19:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:06.258 * Looking for test storage... 00:18:06.258 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:06.258 15:19:09 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:06.258 15:19:09 -- nvmf/common.sh@7 -- # uname -s 00:18:06.258 15:19:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:06.258 15:19:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:06.258 15:19:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:06.258 15:19:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:06.258 15:19:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:06.258 15:19:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:06.258 15:19:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:06.258 15:19:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:06.258 15:19:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:06.258 15:19:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:06.258 15:19:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:18:06.258 15:19:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:18:06.258 15:19:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:06.258 15:19:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:06.258 15:19:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:06.258 15:19:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:06.258 15:19:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:06.258 15:19:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:06.258 15:19:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:06.258 15:19:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:06.258 15:19:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:06.258 15:19:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:06.258 15:19:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:06.258 15:19:09 -- paths/export.sh@5 -- # export PATH 00:18:06.258 15:19:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:06.258 15:19:09 -- nvmf/common.sh@47 -- # : 0 00:18:06.258 15:19:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:06.258 15:19:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:06.258 15:19:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:06.258 15:19:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:06.258 15:19:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:06.258 15:19:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:06.258 15:19:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:06.258 15:19:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:06.258 15:19:09 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:06.258 15:19:09 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:06.258 15:19:09 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:06.258 15:19:09 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:06.258 15:19:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:06.258 15:19:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:06.258 15:19:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:06.258 15:19:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:06.258 15:19:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:06.259 15:19:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:06.259 15:19:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:06.259 15:19:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:06.259 15:19:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:06.259 15:19:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:06.259 15:19:09 -- common/autotest_common.sh@10 -- # set +x 00:18:12.827 15:19:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:12.827 15:19:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:12.827 15:19:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:12.827 15:19:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:12.827 15:19:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:12.827 15:19:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:12.827 15:19:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:12.827 15:19:16 -- nvmf/common.sh@295 -- # net_devs=() 00:18:12.827 15:19:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:12.827 15:19:16 -- nvmf/common.sh@296 -- # e810=() 00:18:12.827 15:19:16 -- nvmf/common.sh@296 -- # local -ga e810 00:18:12.827 15:19:16 -- nvmf/common.sh@297 -- # x722=() 00:18:12.827 15:19:16 -- nvmf/common.sh@297 -- # local -ga x722 00:18:12.827 15:19:16 -- nvmf/common.sh@298 -- # mlx=() 00:18:12.827 15:19:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:12.827 15:19:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:12.827 15:19:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:12.827 15:19:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:18:12.827 Found 0000:18:00.0 (0x8086 - 0x1592) 00:18:12.827 15:19:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:12.827 15:19:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:12.827 15:19:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:18:12.827 Found 0000:18:00.1 (0x8086 - 0x1592) 00:18:12.827 15:19:16 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:12.827 15:19:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@377 -- # modinfo irdma 00:18:12.827 15:19:16 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:18:12.827 15:19:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:12.827 15:19:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:12.827 15:19:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:12.827 15:19:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:18:12.827 Found net devices under 0000:18:00.0: cvl_0_0 00:18:12.827 15:19:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:12.827 15:19:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:12.827 15:19:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:12.827 15:19:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:18:12.827 Found net devices under 0000:18:00.1: cvl_0_1 00:18:12.827 15:19:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:12.827 15:19:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:12.827 15:19:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:12.827 15:19:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:12.827 15:19:16 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:12.828 15:19:16 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:12.828 15:19:16 -- nvmf/common.sh@58 -- # uname 00:18:12.828 15:19:16 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:12.828 15:19:16 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:12.828 15:19:16 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:12.828 15:19:16 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:12.828 15:19:16 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:12.828 15:19:16 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:12.828 15:19:16 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:12.828 15:19:16 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:12.828 15:19:16 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:12.828 15:19:16 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:12.828 15:19:16 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:12.828 15:19:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:12.828 15:19:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:12.828 15:19:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:12.828 15:19:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:12.828 15:19:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:12.828 15:19:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:12.828 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:12.828 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:12.828 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:12.828 15:19:16 -- nvmf/common.sh@105 -- # continue 2 00:18:12.828 15:19:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:12.828 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:12.828 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:12.828 15:19:16 -- nvmf/common.sh@105 -- # continue 2 00:18:12.828 15:19:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:12.828 15:19:16 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:18:12.828 15:19:16 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:12.828 15:19:16 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:12.828 15:19:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:18:12.828 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:12.828 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:18:12.828 altname enp24s0f0np0 00:18:12.828 altname ens785f0np0 00:18:12.828 inet 192.168.100.8/24 scope global cvl_0_0 00:18:12.828 valid_lft forever preferred_lft forever 00:18:12.828 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:18:12.828 valid_lft forever preferred_lft forever 00:18:12.828 15:19:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:12.828 15:19:16 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:18:12.828 15:19:16 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:12.828 15:19:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:12.828 15:19:16 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:12.828 15:19:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:18:12.828 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:12.828 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:18:12.828 altname enp24s0f1np1 00:18:12.828 altname ens785f1np1 00:18:12.828 inet 192.168.100.9/24 scope global cvl_0_1 00:18:12.828 valid_lft forever preferred_lft forever 00:18:12.828 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:18:12.828 valid_lft forever preferred_lft forever 00:18:12.828 15:19:16 -- nvmf/common.sh@411 -- # return 0 00:18:12.828 15:19:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:12.828 15:19:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:12.828 15:19:16 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:12.828 15:19:16 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:12.828 15:19:16 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:12.828 15:19:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:12.828 15:19:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:12.828 15:19:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:12.828 15:19:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:13.087 15:19:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:13.087 15:19:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:13.087 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:13.087 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:13.087 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:13.087 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:13.087 15:19:16 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:13.087 15:19:16 -- nvmf/common.sh@105 -- # continue 2 00:18:13.087 15:19:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:13.087 15:19:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:13.087 15:19:16 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:13.087 15:19:16 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:13.087 15:19:16 -- nvmf/common.sh@105 -- # continue 2 00:18:13.087 15:19:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:13.087 15:19:16 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:18:13.087 15:19:16 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:13.087 15:19:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:13.087 15:19:16 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:18:13.087 15:19:16 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:13.087 15:19:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:13.087 15:19:16 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:13.087 192.168.100.9' 00:18:13.087 15:19:16 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:13.087 192.168.100.9' 00:18:13.087 15:19:16 -- nvmf/common.sh@446 -- # head -n 1 00:18:13.087 15:19:16 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:13.088 15:19:16 -- nvmf/common.sh@447 -- # tail -n +2 00:18:13.088 15:19:16 -- nvmf/common.sh@447 -- # head -n 1 00:18:13.088 15:19:16 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:13.088 192.168.100.9' 00:18:13.088 15:19:16 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:13.088 15:19:16 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:13.088 15:19:16 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:13.088 15:19:16 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:13.088 15:19:16 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:13.088 15:19:16 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:13.088 15:19:16 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:13.088 15:19:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:13.088 15:19:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:13.088 15:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:13.088 15:19:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:13.088 15:19:16 -- nvmf/common.sh@470 -- # nvmfpid=641461 00:18:13.088 15:19:16 -- nvmf/common.sh@471 -- # waitforlisten 641461 00:18:13.088 15:19:16 -- common/autotest_common.sh@817 -- # '[' -z 641461 ']' 00:18:13.088 15:19:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:13.088 15:19:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:13.088 15:19:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:13.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:13.088 15:19:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:13.088 15:19:16 -- common/autotest_common.sh@10 -- # set +x 00:18:13.088 [2024-04-24 15:19:16.852326] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:13.088 [2024-04-24 15:19:16.852382] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:13.088 EAL: No free 2048 kB hugepages reported on node 1 00:18:13.088 [2024-04-24 15:19:16.936833] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:13.347 [2024-04-24 15:19:17.026044] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:13.347 [2024-04-24 15:19:17.026085] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:13.347 [2024-04-24 15:19:17.026095] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:13.347 [2024-04-24 15:19:17.026103] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:13.347 [2024-04-24 15:19:17.026113] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:13.347 [2024-04-24 15:19:17.026165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:13.347 [2024-04-24 15:19:17.026250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:13.347 [2024-04-24 15:19:17.026339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:13.347 [2024-04-24 15:19:17.026341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:13.915 15:19:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:13.915 15:19:17 -- common/autotest_common.sh@850 -- # return 0 00:18:13.915 15:19:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:13.915 15:19:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:13.915 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:13.915 15:19:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:13.915 15:19:17 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:13.915 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:13.915 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:13.915 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:13.915 15:19:17 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:13.915 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:13.915 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:13.915 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:13.915 15:19:17 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:13.915 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:13.915 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:13.915 [2024-04-24 15:19:17.819067] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xb74980/0xb73fc0) succeed. 00:18:14.174 [2024-04-24 15:19:17.829231] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xb75d30/0xb74540) succeed. 00:18:14.174 [2024-04-24 15:19:17.829253] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:18:14.174 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:14.175 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:14.175 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:14.175 Malloc0 00:18:14.175 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:14.175 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:14.175 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:14.175 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:14.175 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:14.175 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:14.175 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:14.175 15:19:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:14.175 15:19:17 -- common/autotest_common.sh@10 -- # set +x 00:18:14.175 [2024-04-24 15:19:17.896562] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:14.175 15:19:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=641524 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@30 -- # READ_PID=641526 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # config=() 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # local subsystem config 00:18:14.175 15:19:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:14.175 { 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme$subsystem", 00:18:14.175 "trtype": "$TEST_TRANSPORT", 00:18:14.175 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "$NVMF_PORT", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.175 "hdgst": ${hdgst:-false}, 00:18:14.175 "ddgst": ${ddgst:-false} 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 } 00:18:14.175 EOF 00:18:14.175 )") 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=641528 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # config=() 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # local subsystem config 00:18:14.175 15:19:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:14.175 { 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme$subsystem", 00:18:14.175 "trtype": "$TEST_TRANSPORT", 00:18:14.175 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "$NVMF_PORT", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.175 "hdgst": ${hdgst:-false}, 00:18:14.175 "ddgst": ${ddgst:-false} 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 } 00:18:14.175 EOF 00:18:14.175 )") 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # cat 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=641532 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@35 -- # sync 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # config=() 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # local subsystem config 00:18:14.175 15:19:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:14.175 { 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme$subsystem", 00:18:14.175 "trtype": "$TEST_TRANSPORT", 00:18:14.175 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "$NVMF_PORT", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.175 "hdgst": ${hdgst:-false}, 00:18:14.175 "ddgst": ${ddgst:-false} 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 } 00:18:14.175 EOF 00:18:14.175 )") 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # config=() 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # cat 00:18:14.175 15:19:17 -- nvmf/common.sh@521 -- # local subsystem config 00:18:14.175 15:19:17 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:14.175 { 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme$subsystem", 00:18:14.175 "trtype": "$TEST_TRANSPORT", 00:18:14.175 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "$NVMF_PORT", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:14.175 "hdgst": ${hdgst:-false}, 00:18:14.175 "ddgst": ${ddgst:-false} 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 } 00:18:14.175 EOF 00:18:14.175 )") 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # cat 00:18:14.175 15:19:17 -- target/bdev_io_wait.sh@37 -- # wait 641524 00:18:14.175 15:19:17 -- nvmf/common.sh@543 -- # cat 00:18:14.175 15:19:17 -- nvmf/common.sh@545 -- # jq . 00:18:14.175 15:19:17 -- nvmf/common.sh@545 -- # jq . 00:18:14.175 15:19:17 -- nvmf/common.sh@545 -- # jq . 00:18:14.175 15:19:17 -- nvmf/common.sh@546 -- # IFS=, 00:18:14.175 15:19:17 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme1", 00:18:14.175 "trtype": "rdma", 00:18:14.175 "traddr": "192.168.100.8", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "4420", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.175 "hdgst": false, 00:18:14.175 "ddgst": false 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 }' 00:18:14.175 15:19:17 -- nvmf/common.sh@545 -- # jq . 00:18:14.175 15:19:17 -- nvmf/common.sh@546 -- # IFS=, 00:18:14.175 15:19:17 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme1", 00:18:14.175 "trtype": "rdma", 00:18:14.175 "traddr": "192.168.100.8", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "4420", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.175 "hdgst": false, 00:18:14.175 "ddgst": false 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 }' 00:18:14.175 15:19:17 -- nvmf/common.sh@546 -- # IFS=, 00:18:14.175 15:19:17 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme1", 00:18:14.175 "trtype": "rdma", 00:18:14.175 "traddr": "192.168.100.8", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "4420", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.175 "hdgst": false, 00:18:14.175 "ddgst": false 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 }' 00:18:14.175 15:19:17 -- nvmf/common.sh@546 -- # IFS=, 00:18:14.175 15:19:17 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:14.175 "params": { 00:18:14.175 "name": "Nvme1", 00:18:14.175 "trtype": "rdma", 00:18:14.175 "traddr": "192.168.100.8", 00:18:14.175 "adrfam": "ipv4", 00:18:14.175 "trsvcid": "4420", 00:18:14.175 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.175 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.175 "hdgst": false, 00:18:14.175 "ddgst": false 00:18:14.175 }, 00:18:14.175 "method": "bdev_nvme_attach_controller" 00:18:14.175 }' 00:18:14.175 [2024-04-24 15:19:17.946026] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:14.175 [2024-04-24 15:19:17.946083] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:14.175 [2024-04-24 15:19:17.949896] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:14.175 [2024-04-24 15:19:17.949944] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:14.175 [2024-04-24 15:19:17.952017] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:14.175 [2024-04-24 15:19:17.952019] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:14.175 [2024-04-24 15:19:17.952072] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-04-24 15:19:17.952072] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:14.175 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:14.175 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.435 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.435 [2024-04-24 15:19:18.152347] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.435 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.435 [2024-04-24 15:19:18.228518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:14.435 [2024-04-24 15:19:18.253838] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.435 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.435 [2024-04-24 15:19:18.286981] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.435 [2024-04-24 15:19:18.339844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:14.694 [2024-04-24 15:19:18.356626] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.694 [2024-04-24 15:19:18.362290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:14.694 [2024-04-24 15:19:18.431322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:14.694 Running I/O for 1 seconds... 00:18:14.694 Running I/O for 1 seconds... 00:18:14.694 Running I/O for 1 seconds... 00:18:14.694 Running I/O for 1 seconds... 00:18:15.630 00:18:15.630 Latency(us) 00:18:15.630 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.630 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:15.630 Nvme1n1 : 1.01 18361.70 71.73 0.00 0.00 6950.01 4103.12 15044.79 00:18:15.630 =================================================================================================================== 00:18:15.630 Total : 18361.70 71.73 0.00 0.00 6950.01 4103.12 15044.79 00:18:15.631 00:18:15.631 Latency(us) 00:18:15.631 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.631 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:15.631 Nvme1n1 : 1.01 14926.46 58.31 0.00 0.00 8549.77 5214.39 18692.01 00:18:15.631 =================================================================================================================== 00:18:15.631 Total : 14926.46 58.31 0.00 0.00 8549.77 5214.39 18692.01 00:18:15.631 00:18:15.631 Latency(us) 00:18:15.631 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.631 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:15.631 Nvme1n1 : 1.00 17866.77 69.79 0.00 0.00 7148.99 3376.53 14816.83 00:18:15.631 =================================================================================================================== 00:18:15.631 Total : 17866.77 69.79 0.00 0.00 7148.99 3376.53 14816.83 00:18:15.890 00:18:15.890 Latency(us) 00:18:15.890 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.890 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:15.890 Nvme1n1 : 1.00 261456.20 1021.31 0.00 0.00 487.25 195.90 2023.07 00:18:15.890 =================================================================================================================== 00:18:15.890 Total : 261456.20 1021.31 0.00 0.00 487.25 195.90 2023.07 00:18:15.890 15:19:19 -- target/bdev_io_wait.sh@38 -- # wait 641526 00:18:16.149 15:19:19 -- target/bdev_io_wait.sh@39 -- # wait 641528 00:18:16.149 15:19:19 -- target/bdev_io_wait.sh@40 -- # wait 641532 00:18:16.149 15:19:19 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:16.149 15:19:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:16.149 15:19:19 -- common/autotest_common.sh@10 -- # set +x 00:18:16.149 15:19:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:16.149 15:19:19 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:16.149 15:19:19 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:16.149 15:19:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:16.149 15:19:19 -- nvmf/common.sh@117 -- # sync 00:18:16.149 15:19:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:16.149 15:19:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:16.149 15:19:19 -- nvmf/common.sh@120 -- # set +e 00:18:16.149 15:19:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:16.149 15:19:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:16.149 rmmod nvme_rdma 00:18:16.149 rmmod nvme_fabrics 00:18:16.149 15:19:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:16.149 15:19:19 -- nvmf/common.sh@124 -- # set -e 00:18:16.149 15:19:19 -- nvmf/common.sh@125 -- # return 0 00:18:16.149 15:19:19 -- nvmf/common.sh@478 -- # '[' -n 641461 ']' 00:18:16.149 15:19:19 -- nvmf/common.sh@479 -- # killprocess 641461 00:18:16.149 15:19:19 -- common/autotest_common.sh@936 -- # '[' -z 641461 ']' 00:18:16.149 15:19:19 -- common/autotest_common.sh@940 -- # kill -0 641461 00:18:16.149 15:19:19 -- common/autotest_common.sh@941 -- # uname 00:18:16.149 15:19:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.149 15:19:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 641461 00:18:16.149 15:19:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:16.149 15:19:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:16.149 15:19:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 641461' 00:18:16.149 killing process with pid 641461 00:18:16.149 15:19:19 -- common/autotest_common.sh@955 -- # kill 641461 00:18:16.149 15:19:19 -- common/autotest_common.sh@960 -- # wait 641461 00:18:16.149 [2024-04-24 15:19:20.011938] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:16.408 15:19:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:16.408 15:19:20 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:16.408 00:18:16.408 real 0m10.370s 00:18:16.408 user 0m20.445s 00:18:16.408 sys 0m6.661s 00:18:16.408 15:19:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:16.408 15:19:20 -- common/autotest_common.sh@10 -- # set +x 00:18:16.408 ************************************ 00:18:16.408 END TEST nvmf_bdev_io_wait 00:18:16.408 ************************************ 00:18:16.408 15:19:20 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:16.408 15:19:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:16.408 15:19:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:16.408 15:19:20 -- common/autotest_common.sh@10 -- # set +x 00:18:16.668 ************************************ 00:18:16.668 START TEST nvmf_queue_depth 00:18:16.668 ************************************ 00:18:16.668 15:19:20 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:16.668 * Looking for test storage... 00:18:16.668 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:16.668 15:19:20 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:16.668 15:19:20 -- nvmf/common.sh@7 -- # uname -s 00:18:16.668 15:19:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:16.668 15:19:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:16.668 15:19:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:16.668 15:19:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:16.668 15:19:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:16.668 15:19:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:16.668 15:19:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:16.668 15:19:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:16.668 15:19:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:16.668 15:19:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:16.668 15:19:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:18:16.668 15:19:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:18:16.668 15:19:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:16.668 15:19:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:16.668 15:19:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:16.668 15:19:20 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:16.668 15:19:20 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:16.668 15:19:20 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:16.668 15:19:20 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:16.668 15:19:20 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:16.668 15:19:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.668 15:19:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.668 15:19:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.668 15:19:20 -- paths/export.sh@5 -- # export PATH 00:18:16.668 15:19:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.668 15:19:20 -- nvmf/common.sh@47 -- # : 0 00:18:16.668 15:19:20 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:16.668 15:19:20 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:16.668 15:19:20 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:16.668 15:19:20 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:16.668 15:19:20 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:16.668 15:19:20 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:16.668 15:19:20 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:16.668 15:19:20 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:16.668 15:19:20 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:16.668 15:19:20 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:16.668 15:19:20 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:16.668 15:19:20 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:16.668 15:19:20 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:16.668 15:19:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:16.668 15:19:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:16.668 15:19:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:16.668 15:19:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:16.668 15:19:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.668 15:19:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.668 15:19:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.668 15:19:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:16.668 15:19:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:16.668 15:19:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:16.668 15:19:20 -- common/autotest_common.sh@10 -- # set +x 00:18:24.782 15:19:27 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.782 15:19:27 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:24.782 15:19:27 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:24.782 15:19:27 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:24.782 15:19:27 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:24.782 15:19:27 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:24.782 15:19:27 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:24.782 15:19:27 -- nvmf/common.sh@295 -- # net_devs=() 00:18:24.782 15:19:27 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:24.782 15:19:27 -- nvmf/common.sh@296 -- # e810=() 00:18:24.782 15:19:27 -- nvmf/common.sh@296 -- # local -ga e810 00:18:24.782 15:19:27 -- nvmf/common.sh@297 -- # x722=() 00:18:24.782 15:19:27 -- nvmf/common.sh@297 -- # local -ga x722 00:18:24.782 15:19:27 -- nvmf/common.sh@298 -- # mlx=() 00:18:24.782 15:19:27 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:24.782 15:19:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.782 15:19:27 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:24.782 15:19:27 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:24.783 15:19:27 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:24.783 15:19:27 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:24.783 15:19:27 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:18:24.783 Found 0000:18:00.0 (0x8086 - 0x1592) 00:18:24.783 15:19:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:24.783 15:19:27 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:18:24.783 Found 0000:18:00.1 (0x8086 - 0x1592) 00:18:24.783 15:19:27 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:24.783 15:19:27 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@377 -- # modinfo irdma 00:18:24.783 15:19:27 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:18:24.783 15:19:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.783 15:19:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.783 15:19:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:18:24.783 Found net devices under 0000:18:00.0: cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.783 15:19:27 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.783 15:19:27 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.783 15:19:27 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:18:24.783 Found net devices under 0000:18:00.1: cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.783 15:19:27 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:24.783 15:19:27 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:24.783 15:19:27 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:24.783 15:19:27 -- nvmf/common.sh@58 -- # uname 00:18:24.783 15:19:27 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:24.783 15:19:27 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:24.783 15:19:27 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:24.783 15:19:27 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:24.783 15:19:27 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:24.783 15:19:27 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:24.783 15:19:27 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:24.783 15:19:27 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:24.783 15:19:27 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:24.783 15:19:27 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:24.783 15:19:27 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:24.783 15:19:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:24.783 15:19:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:24.783 15:19:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:24.783 15:19:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:24.783 15:19:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@105 -- # continue 2 00:18:24.783 15:19:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@105 -- # continue 2 00:18:24.783 15:19:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:24.783 15:19:27 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.783 15:19:27 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:24.783 15:19:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:18:24.783 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:24.783 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:18:24.783 altname enp24s0f0np0 00:18:24.783 altname ens785f0np0 00:18:24.783 inet 192.168.100.8/24 scope global cvl_0_0 00:18:24.783 valid_lft forever preferred_lft forever 00:18:24.783 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:18:24.783 valid_lft forever preferred_lft forever 00:18:24.783 15:19:27 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:24.783 15:19:27 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.783 15:19:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.783 15:19:27 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:24.783 15:19:27 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:18:24.783 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:24.783 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:18:24.783 altname enp24s0f1np1 00:18:24.783 altname ens785f1np1 00:18:24.783 inet 192.168.100.9/24 scope global cvl_0_1 00:18:24.783 valid_lft forever preferred_lft forever 00:18:24.783 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:18:24.783 valid_lft forever preferred_lft forever 00:18:24.783 15:19:27 -- nvmf/common.sh@411 -- # return 0 00:18:24.783 15:19:27 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:24.783 15:19:27 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:24.783 15:19:27 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:24.783 15:19:27 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:24.783 15:19:27 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:24.783 15:19:27 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:24.783 15:19:27 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:24.783 15:19:27 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:24.783 15:19:27 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:24.783 15:19:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:24.783 15:19:27 -- nvmf/common.sh@105 -- # continue 2 00:18:24.783 15:19:27 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.783 15:19:27 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:24.783 15:19:27 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:24.783 15:19:27 -- nvmf/common.sh@105 -- # continue 2 00:18:24.783 15:19:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:24.784 15:19:27 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:18:24.784 15:19:27 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.784 15:19:27 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:24.784 15:19:27 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:18:24.784 15:19:27 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.784 15:19:27 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.784 15:19:27 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:24.784 192.168.100.9' 00:18:24.784 15:19:27 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:24.784 192.168.100.9' 00:18:24.784 15:19:27 -- nvmf/common.sh@446 -- # head -n 1 00:18:24.784 15:19:27 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:24.784 15:19:27 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:24.784 192.168.100.9' 00:18:24.784 15:19:27 -- nvmf/common.sh@447 -- # tail -n +2 00:18:24.784 15:19:27 -- nvmf/common.sh@447 -- # head -n 1 00:18:24.784 15:19:27 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:24.784 15:19:27 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:24.784 15:19:27 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:24.784 15:19:27 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:24.784 15:19:27 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:24.784 15:19:27 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:24.784 15:19:27 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:24.784 15:19:27 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:24.784 15:19:27 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:24.784 15:19:27 -- common/autotest_common.sh@10 -- # set +x 00:18:24.784 15:19:27 -- nvmf/common.sh@470 -- # nvmfpid=645263 00:18:24.784 15:19:27 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:24.784 15:19:27 -- nvmf/common.sh@471 -- # waitforlisten 645263 00:18:24.784 15:19:27 -- common/autotest_common.sh@817 -- # '[' -z 645263 ']' 00:18:24.784 15:19:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.784 15:19:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:24.784 15:19:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.784 15:19:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:24.784 15:19:27 -- common/autotest_common.sh@10 -- # set +x 00:18:24.784 [2024-04-24 15:19:28.015016] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:24.784 [2024-04-24 15:19:28.015071] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.784 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.784 [2024-04-24 15:19:28.096259] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.784 [2024-04-24 15:19:28.175906] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.784 [2024-04-24 15:19:28.175948] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.784 [2024-04-24 15:19:28.175957] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:24.784 [2024-04-24 15:19:28.175965] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:24.784 [2024-04-24 15:19:28.175973] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.784 [2024-04-24 15:19:28.176000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.043 15:19:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:25.043 15:19:28 -- common/autotest_common.sh@850 -- # return 0 00:18:25.043 15:19:28 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:25.043 15:19:28 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 15:19:28 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.043 15:19:28 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:25.043 15:19:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 [2024-04-24 15:19:28.874730] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xedeb00/0xede140) succeed. 00:18:25.043 [2024-04-24 15:19:28.883823] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xedfdb0/0xede6c0) succeed. 00:18:25.043 [2024-04-24 15:19:28.883847] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:18:25.043 15:19:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.043 15:19:28 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:25.043 15:19:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 Malloc0 00:18:25.043 15:19:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.043 15:19:28 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:25.043 15:19:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 15:19:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.043 15:19:28 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:25.043 15:19:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 15:19:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.043 15:19:28 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:25.043 15:19:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.043 [2024-04-24 15:19:28.941689] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:25.043 15:19:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.043 15:19:28 -- target/queue_depth.sh@30 -- # bdevperf_pid=645432 00:18:25.043 15:19:28 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:25.043 15:19:28 -- target/queue_depth.sh@33 -- # waitforlisten 645432 /var/tmp/bdevperf.sock 00:18:25.043 15:19:28 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:25.043 15:19:28 -- common/autotest_common.sh@817 -- # '[' -z 645432 ']' 00:18:25.043 15:19:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:25.043 15:19:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:25.043 15:19:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:25.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:25.043 15:19:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:25.043 15:19:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.302 [2024-04-24 15:19:28.977539] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:25.302 [2024-04-24 15:19:28.977590] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid645432 ] 00:18:25.302 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.302 [2024-04-24 15:19:29.056208] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.302 [2024-04-24 15:19:29.132332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:25.867 15:19:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:25.867 15:19:29 -- common/autotest_common.sh@850 -- # return 0 00:18:25.867 15:19:29 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:25.867 15:19:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.867 15:19:29 -- common/autotest_common.sh@10 -- # set +x 00:18:26.125 NVMe0n1 00:18:26.125 15:19:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:26.125 15:19:29 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:26.125 Running I/O for 10 seconds... 00:18:36.100 00:18:36.100 Latency(us) 00:18:36.100 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.100 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:36.100 Verification LBA range: start 0x0 length 0x4000 00:18:36.100 NVMe0n1 : 10.03 17687.90 69.09 0.00 0.00 57729.43 5328.36 41259.19 00:18:36.100 =================================================================================================================== 00:18:36.100 Total : 17687.90 69.09 0.00 0.00 57729.43 5328.36 41259.19 00:18:36.100 0 00:18:36.100 15:19:40 -- target/queue_depth.sh@39 -- # killprocess 645432 00:18:36.100 15:19:40 -- common/autotest_common.sh@936 -- # '[' -z 645432 ']' 00:18:36.100 15:19:40 -- common/autotest_common.sh@940 -- # kill -0 645432 00:18:36.100 15:19:40 -- common/autotest_common.sh@941 -- # uname 00:18:36.360 15:19:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:36.360 15:19:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 645432 00:18:36.360 15:19:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:36.360 15:19:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:36.360 15:19:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 645432' 00:18:36.360 killing process with pid 645432 00:18:36.360 15:19:40 -- common/autotest_common.sh@955 -- # kill 645432 00:18:36.360 Received shutdown signal, test time was about 10.000000 seconds 00:18:36.360 00:18:36.360 Latency(us) 00:18:36.360 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.360 =================================================================================================================== 00:18:36.360 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:36.360 15:19:40 -- common/autotest_common.sh@960 -- # wait 645432 00:18:36.619 15:19:40 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:36.619 15:19:40 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:36.619 15:19:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:36.619 15:19:40 -- nvmf/common.sh@117 -- # sync 00:18:36.620 15:19:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:36.620 15:19:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:36.620 15:19:40 -- nvmf/common.sh@120 -- # set +e 00:18:36.620 15:19:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:36.620 15:19:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:36.620 rmmod nvme_rdma 00:18:36.620 rmmod nvme_fabrics 00:18:36.620 15:19:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:36.620 15:19:40 -- nvmf/common.sh@124 -- # set -e 00:18:36.620 15:19:40 -- nvmf/common.sh@125 -- # return 0 00:18:36.620 15:19:40 -- nvmf/common.sh@478 -- # '[' -n 645263 ']' 00:18:36.620 15:19:40 -- nvmf/common.sh@479 -- # killprocess 645263 00:18:36.620 15:19:40 -- common/autotest_common.sh@936 -- # '[' -z 645263 ']' 00:18:36.620 15:19:40 -- common/autotest_common.sh@940 -- # kill -0 645263 00:18:36.620 15:19:40 -- common/autotest_common.sh@941 -- # uname 00:18:36.620 15:19:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:36.620 15:19:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 645263 00:18:36.620 15:19:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:36.620 15:19:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:36.620 15:19:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 645263' 00:18:36.620 killing process with pid 645263 00:18:36.620 15:19:40 -- common/autotest_common.sh@955 -- # kill 645263 00:18:36.620 15:19:40 -- common/autotest_common.sh@960 -- # wait 645263 00:18:36.620 [2024-04-24 15:19:40.412902] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:36.879 15:19:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:36.879 15:19:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:36.879 00:18:36.879 real 0m20.266s 00:18:36.879 user 0m26.242s 00:18:36.879 sys 0m6.421s 00:18:36.879 15:19:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:36.879 15:19:40 -- common/autotest_common.sh@10 -- # set +x 00:18:36.879 ************************************ 00:18:36.879 END TEST nvmf_queue_depth 00:18:36.879 ************************************ 00:18:36.879 15:19:40 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:36.879 15:19:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:36.879 15:19:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:36.879 15:19:40 -- common/autotest_common.sh@10 -- # set +x 00:18:37.139 ************************************ 00:18:37.139 START TEST nvmf_multipath 00:18:37.139 ************************************ 00:18:37.139 15:19:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:37.139 * Looking for test storage... 00:18:37.139 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:37.139 15:19:40 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:37.139 15:19:40 -- nvmf/common.sh@7 -- # uname -s 00:18:37.139 15:19:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:37.139 15:19:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:37.139 15:19:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:37.139 15:19:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:37.139 15:19:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:37.139 15:19:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:37.139 15:19:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:37.139 15:19:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:37.139 15:19:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:37.139 15:19:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:37.139 15:19:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:18:37.139 15:19:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:18:37.139 15:19:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:37.139 15:19:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:37.139 15:19:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:37.139 15:19:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:37.139 15:19:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:37.139 15:19:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:37.139 15:19:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:37.139 15:19:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:37.139 15:19:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.139 15:19:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.139 15:19:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.139 15:19:40 -- paths/export.sh@5 -- # export PATH 00:18:37.139 15:19:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.139 15:19:40 -- nvmf/common.sh@47 -- # : 0 00:18:37.139 15:19:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:37.139 15:19:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:37.139 15:19:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:37.139 15:19:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:37.139 15:19:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:37.139 15:19:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:37.139 15:19:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:37.139 15:19:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:37.139 15:19:40 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:37.140 15:19:40 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:37.140 15:19:40 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:37.140 15:19:40 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:18:37.140 15:19:40 -- target/multipath.sh@43 -- # nvmftestinit 00:18:37.140 15:19:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:37.140 15:19:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.140 15:19:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:37.140 15:19:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:37.140 15:19:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:37.140 15:19:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.140 15:19:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.140 15:19:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.140 15:19:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:37.140 15:19:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:37.140 15:19:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:37.140 15:19:40 -- common/autotest_common.sh@10 -- # set +x 00:18:45.258 15:19:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:45.258 15:19:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:45.258 15:19:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:45.258 15:19:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:45.258 15:19:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:45.258 15:19:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:45.258 15:19:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:45.258 15:19:47 -- nvmf/common.sh@295 -- # net_devs=() 00:18:45.258 15:19:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:45.258 15:19:47 -- nvmf/common.sh@296 -- # e810=() 00:18:45.258 15:19:47 -- nvmf/common.sh@296 -- # local -ga e810 00:18:45.258 15:19:47 -- nvmf/common.sh@297 -- # x722=() 00:18:45.258 15:19:47 -- nvmf/common.sh@297 -- # local -ga x722 00:18:45.258 15:19:47 -- nvmf/common.sh@298 -- # mlx=() 00:18:45.258 15:19:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:45.258 15:19:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:45.258 15:19:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:45.258 15:19:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:45.258 15:19:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:45.258 15:19:47 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:45.258 15:19:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:45.258 15:19:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:45.258 15:19:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:18:45.258 Found 0000:18:00.0 (0x8086 - 0x1592) 00:18:45.258 15:19:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:45.258 15:19:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:45.258 15:19:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:18:45.258 Found 0000:18:00.1 (0x8086 - 0x1592) 00:18:45.258 15:19:47 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:45.258 15:19:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:45.258 15:19:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:45.258 15:19:47 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@377 -- # modinfo irdma 00:18:45.259 15:19:47 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:18:45.259 15:19:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.259 15:19:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.259 15:19:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:18:45.259 Found net devices under 0000:18:00.0: cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.259 15:19:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:45.259 15:19:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:45.259 15:19:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:18:45.259 Found net devices under 0000:18:00.1: cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:45.259 15:19:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:45.259 15:19:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:45.259 15:19:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:45.259 15:19:47 -- nvmf/common.sh@58 -- # uname 00:18:45.259 15:19:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:45.259 15:19:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:45.259 15:19:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:45.259 15:19:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:45.259 15:19:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:45.259 15:19:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:45.259 15:19:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:45.259 15:19:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:45.259 15:19:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:45.259 15:19:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:45.259 15:19:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:45.259 15:19:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:45.259 15:19:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:45.259 15:19:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:45.259 15:19:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@105 -- # continue 2 00:18:45.259 15:19:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@105 -- # continue 2 00:18:45.259 15:19:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:45.259 15:19:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.259 15:19:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:45.259 15:19:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:18:45.259 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:45.259 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:18:45.259 altname enp24s0f0np0 00:18:45.259 altname ens785f0np0 00:18:45.259 inet 192.168.100.8/24 scope global cvl_0_0 00:18:45.259 valid_lft forever preferred_lft forever 00:18:45.259 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:18:45.259 valid_lft forever preferred_lft forever 00:18:45.259 15:19:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:45.259 15:19:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.259 15:19:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:45.259 15:19:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:18:45.259 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:45.259 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:18:45.259 altname enp24s0f1np1 00:18:45.259 altname ens785f1np1 00:18:45.259 inet 192.168.100.9/24 scope global cvl_0_1 00:18:45.259 valid_lft forever preferred_lft forever 00:18:45.259 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:18:45.259 valid_lft forever preferred_lft forever 00:18:45.259 15:19:47 -- nvmf/common.sh@411 -- # return 0 00:18:45.259 15:19:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:45.259 15:19:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:45.259 15:19:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:45.259 15:19:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:45.259 15:19:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:45.259 15:19:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:45.259 15:19:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:45.259 15:19:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:45.259 15:19:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@105 -- # continue 2 00:18:45.259 15:19:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:45.259 15:19:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:45.259 15:19:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@105 -- # continue 2 00:18:45.259 15:19:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:45.259 15:19:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.259 15:19:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:45.259 15:19:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:45.259 15:19:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:45.259 15:19:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:45.259 192.168.100.9' 00:18:45.259 15:19:47 -- nvmf/common.sh@446 -- # head -n 1 00:18:45.259 15:19:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:45.259 192.168.100.9' 00:18:45.259 15:19:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:45.259 15:19:47 -- nvmf/common.sh@447 -- # tail -n +2 00:18:45.259 15:19:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:45.259 192.168.100.9' 00:18:45.259 15:19:47 -- nvmf/common.sh@447 -- # head -n 1 00:18:45.259 15:19:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:45.259 15:19:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:45.259 15:19:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:45.259 15:19:47 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:18:45.259 15:19:47 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:18:45.259 15:19:47 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:18:45.259 run this test only with TCP transport for now 00:18:45.259 15:19:47 -- target/multipath.sh@53 -- # nvmftestfini 00:18:45.259 15:19:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:45.259 15:19:47 -- nvmf/common.sh@117 -- # sync 00:18:45.259 15:19:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:45.259 15:19:47 -- nvmf/common.sh@120 -- # set +e 00:18:45.260 15:19:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:45.260 15:19:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:45.260 rmmod nvme_rdma 00:18:45.260 rmmod nvme_fabrics 00:18:45.260 15:19:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:45.260 15:19:47 -- nvmf/common.sh@124 -- # set -e 00:18:45.260 15:19:47 -- nvmf/common.sh@125 -- # return 0 00:18:45.260 15:19:47 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:45.260 15:19:47 -- target/multipath.sh@54 -- # exit 0 00:18:45.260 15:19:47 -- target/multipath.sh@1 -- # nvmftestfini 00:18:45.260 15:19:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:45.260 15:19:47 -- nvmf/common.sh@117 -- # sync 00:18:45.260 15:19:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@120 -- # set +e 00:18:45.260 15:19:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:45.260 15:19:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:45.260 15:19:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:45.260 15:19:47 -- nvmf/common.sh@124 -- # set -e 00:18:45.260 15:19:47 -- nvmf/common.sh@125 -- # return 0 00:18:45.260 15:19:47 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:45.260 15:19:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:45.260 00:18:45.260 real 0m7.110s 00:18:45.260 user 0m2.114s 00:18:45.260 sys 0m5.220s 00:18:45.260 15:19:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:45.260 15:19:47 -- common/autotest_common.sh@10 -- # set +x 00:18:45.260 ************************************ 00:18:45.260 END TEST nvmf_multipath 00:18:45.260 ************************************ 00:18:45.260 15:19:48 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:18:45.260 15:19:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:45.260 15:19:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:45.260 15:19:48 -- common/autotest_common.sh@10 -- # set +x 00:18:45.260 ************************************ 00:18:45.260 START TEST nvmf_zcopy 00:18:45.260 ************************************ 00:18:45.260 15:19:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:18:45.260 * Looking for test storage... 00:18:45.260 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:45.260 15:19:48 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:45.260 15:19:48 -- nvmf/common.sh@7 -- # uname -s 00:18:45.260 15:19:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:45.260 15:19:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:45.260 15:19:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:45.260 15:19:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:45.260 15:19:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:45.260 15:19:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:45.260 15:19:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:45.260 15:19:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:45.260 15:19:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:45.260 15:19:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:45.260 15:19:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:18:45.260 15:19:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:18:45.260 15:19:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:45.260 15:19:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:45.260 15:19:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:45.260 15:19:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:45.260 15:19:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:45.260 15:19:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:45.260 15:19:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:45.260 15:19:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:45.260 15:19:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.260 15:19:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.260 15:19:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.260 15:19:48 -- paths/export.sh@5 -- # export PATH 00:18:45.260 15:19:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:45.260 15:19:48 -- nvmf/common.sh@47 -- # : 0 00:18:45.260 15:19:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:45.260 15:19:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:45.260 15:19:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:45.260 15:19:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:45.260 15:19:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:45.260 15:19:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:45.260 15:19:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:45.260 15:19:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:45.260 15:19:48 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:45.260 15:19:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:45.260 15:19:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:45.260 15:19:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:45.260 15:19:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:45.260 15:19:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:45.260 15:19:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.260 15:19:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.260 15:19:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:45.260 15:19:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:45.260 15:19:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:45.260 15:19:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:45.260 15:19:48 -- common/autotest_common.sh@10 -- # set +x 00:18:51.829 15:19:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:51.829 15:19:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:51.829 15:19:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:51.829 15:19:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:51.829 15:19:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:51.829 15:19:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:51.829 15:19:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:51.829 15:19:55 -- nvmf/common.sh@295 -- # net_devs=() 00:18:51.829 15:19:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:51.829 15:19:55 -- nvmf/common.sh@296 -- # e810=() 00:18:51.829 15:19:55 -- nvmf/common.sh@296 -- # local -ga e810 00:18:51.829 15:19:55 -- nvmf/common.sh@297 -- # x722=() 00:18:51.829 15:19:55 -- nvmf/common.sh@297 -- # local -ga x722 00:18:51.829 15:19:55 -- nvmf/common.sh@298 -- # mlx=() 00:18:51.829 15:19:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:51.829 15:19:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:51.829 15:19:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:51.829 15:19:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:51.829 15:19:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:51.829 15:19:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:51.829 15:19:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:18:51.829 15:19:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:18:51.830 15:19:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:18:51.830 Found 0000:18:00.0 (0x8086 - 0x1592) 00:18:51.830 15:19:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:51.830 15:19:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:18:51.830 Found 0000:18:00.1 (0x8086 - 0x1592) 00:18:51.830 15:19:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:51.830 15:19:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@377 -- # modinfo irdma 00:18:51.830 15:19:55 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:18:51.830 15:19:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:51.830 15:19:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:51.830 15:19:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:18:51.830 Found net devices under 0000:18:00.0: cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:51.830 15:19:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:51.830 15:19:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:51.830 15:19:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:18:51.830 Found net devices under 0000:18:00.1: cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:51.830 15:19:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:51.830 15:19:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:51.830 15:19:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:51.830 15:19:55 -- nvmf/common.sh@58 -- # uname 00:18:51.830 15:19:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:51.830 15:19:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:51.830 15:19:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:51.830 15:19:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:51.830 15:19:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:51.830 15:19:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:51.830 15:19:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:51.830 15:19:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:51.830 15:19:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:51.830 15:19:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:51.830 15:19:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:51.830 15:19:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:51.830 15:19:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:51.830 15:19:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:51.830 15:19:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:51.830 15:19:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@105 -- # continue 2 00:18:51.830 15:19:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@105 -- # continue 2 00:18:51.830 15:19:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:51.830 15:19:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.830 15:19:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:51.830 15:19:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:18:51.830 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:51.830 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:18:51.830 altname enp24s0f0np0 00:18:51.830 altname ens785f0np0 00:18:51.830 inet 192.168.100.8/24 scope global cvl_0_0 00:18:51.830 valid_lft forever preferred_lft forever 00:18:51.830 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:18:51.830 valid_lft forever preferred_lft forever 00:18:51.830 15:19:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:51.830 15:19:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.830 15:19:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:51.830 15:19:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:18:51.830 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:18:51.830 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:18:51.830 altname enp24s0f1np1 00:18:51.830 altname ens785f1np1 00:18:51.830 inet 192.168.100.9/24 scope global cvl_0_1 00:18:51.830 valid_lft forever preferred_lft forever 00:18:51.830 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:18:51.830 valid_lft forever preferred_lft forever 00:18:51.830 15:19:55 -- nvmf/common.sh@411 -- # return 0 00:18:51.830 15:19:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:51.830 15:19:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:51.830 15:19:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:51.830 15:19:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:51.830 15:19:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:51.830 15:19:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:51.830 15:19:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:51.830 15:19:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:51.830 15:19:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:51.830 15:19:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@105 -- # continue 2 00:18:51.830 15:19:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:51.830 15:19:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:18:51.830 15:19:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@105 -- # continue 2 00:18:51.830 15:19:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:51.830 15:19:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.830 15:19:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:51.830 15:19:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:51.830 15:19:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:51.830 15:19:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:51.830 192.168.100.9' 00:18:51.830 15:19:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:51.830 192.168.100.9' 00:18:51.830 15:19:55 -- nvmf/common.sh@446 -- # head -n 1 00:18:51.830 15:19:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:51.830 15:19:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:51.830 192.168.100.9' 00:18:51.830 15:19:55 -- nvmf/common.sh@447 -- # tail -n +2 00:18:51.830 15:19:55 -- nvmf/common.sh@447 -- # head -n 1 00:18:51.830 15:19:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:51.830 15:19:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:51.830 15:19:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:51.830 15:19:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:51.830 15:19:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:51.830 15:19:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:51.830 15:19:55 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:51.830 15:19:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:51.830 15:19:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:51.830 15:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:51.830 15:19:55 -- nvmf/common.sh@470 -- # nvmfpid=653434 00:18:51.830 15:19:55 -- nvmf/common.sh@471 -- # waitforlisten 653434 00:18:51.830 15:19:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:51.830 15:19:55 -- common/autotest_common.sh@817 -- # '[' -z 653434 ']' 00:18:51.830 15:19:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:51.830 15:19:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:51.830 15:19:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:51.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:51.830 15:19:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:51.830 15:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:51.830 [2024-04-24 15:19:55.602047] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:18:51.830 [2024-04-24 15:19:55.602104] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:51.830 EAL: No free 2048 kB hugepages reported on node 1 00:18:51.830 [2024-04-24 15:19:55.680781] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:52.089 [2024-04-24 15:19:55.766706] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:52.089 [2024-04-24 15:19:55.766743] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:52.089 [2024-04-24 15:19:55.766753] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:52.089 [2024-04-24 15:19:55.766762] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:52.089 [2024-04-24 15:19:55.766769] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:52.089 [2024-04-24 15:19:55.766793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:52.658 15:19:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:52.658 15:19:56 -- common/autotest_common.sh@850 -- # return 0 00:18:52.658 15:19:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:52.658 15:19:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:52.658 15:19:56 -- common/autotest_common.sh@10 -- # set +x 00:18:52.658 15:19:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:52.658 15:19:56 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:18:52.658 15:19:56 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:18:52.658 Unsupported transport: rdma 00:18:52.658 15:19:56 -- target/zcopy.sh@17 -- # exit 0 00:18:52.658 15:19:56 -- target/zcopy.sh@1 -- # process_shm --id 0 00:18:52.658 15:19:56 -- common/autotest_common.sh@794 -- # type=--id 00:18:52.658 15:19:56 -- common/autotest_common.sh@795 -- # id=0 00:18:52.658 15:19:56 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:18:52.658 15:19:56 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:52.658 15:19:56 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:18:52.658 15:19:56 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:18:52.658 15:19:56 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:18:52.658 15:19:56 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:52.658 nvmf_trace.0 00:18:52.658 15:19:56 -- common/autotest_common.sh@809 -- # return 0 00:18:52.658 15:19:56 -- target/zcopy.sh@1 -- # nvmftestfini 00:18:52.658 15:19:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:52.658 15:19:56 -- nvmf/common.sh@117 -- # sync 00:18:52.658 15:19:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:52.658 15:19:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:52.658 15:19:56 -- nvmf/common.sh@120 -- # set +e 00:18:52.658 15:19:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:52.658 15:19:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:52.658 rmmod nvme_rdma 00:18:52.658 rmmod nvme_fabrics 00:18:52.658 15:19:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:52.658 15:19:56 -- nvmf/common.sh@124 -- # set -e 00:18:52.658 15:19:56 -- nvmf/common.sh@125 -- # return 0 00:18:52.658 15:19:56 -- nvmf/common.sh@478 -- # '[' -n 653434 ']' 00:18:52.658 15:19:56 -- nvmf/common.sh@479 -- # killprocess 653434 00:18:52.658 15:19:56 -- common/autotest_common.sh@936 -- # '[' -z 653434 ']' 00:18:52.658 15:19:56 -- common/autotest_common.sh@940 -- # kill -0 653434 00:18:52.658 15:19:56 -- common/autotest_common.sh@941 -- # uname 00:18:52.658 15:19:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.658 15:19:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 653434 00:18:52.918 15:19:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:52.918 15:19:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:52.918 15:19:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 653434' 00:18:52.918 killing process with pid 653434 00:18:52.918 15:19:56 -- common/autotest_common.sh@955 -- # kill 653434 00:18:52.918 15:19:56 -- common/autotest_common.sh@960 -- # wait 653434 00:18:52.918 15:19:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:52.918 15:19:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:52.918 00:18:52.918 real 0m8.629s 00:18:52.918 user 0m3.546s 00:18:52.918 sys 0m5.830s 00:18:52.918 15:19:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:52.918 15:19:56 -- common/autotest_common.sh@10 -- # set +x 00:18:52.918 ************************************ 00:18:52.918 END TEST nvmf_zcopy 00:18:52.918 ************************************ 00:18:53.177 15:19:56 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:18:53.177 15:19:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:53.177 15:19:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:53.177 15:19:56 -- common/autotest_common.sh@10 -- # set +x 00:18:53.177 ************************************ 00:18:53.177 START TEST nvmf_nmic 00:18:53.177 ************************************ 00:18:53.177 15:19:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:18:53.177 * Looking for test storage... 00:18:53.177 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:18:53.177 15:19:57 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:18:53.177 15:19:57 -- nvmf/common.sh@7 -- # uname -s 00:18:53.437 15:19:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:53.437 15:19:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:53.437 15:19:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:53.437 15:19:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:53.437 15:19:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:53.437 15:19:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:53.437 15:19:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:53.437 15:19:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:53.437 15:19:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:53.437 15:19:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:53.437 15:19:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:18:53.437 15:19:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:18:53.437 15:19:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:53.437 15:19:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:53.438 15:19:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:53.438 15:19:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:53.438 15:19:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:18:53.438 15:19:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:53.438 15:19:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:53.438 15:19:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:53.438 15:19:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.438 15:19:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.438 15:19:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.438 15:19:57 -- paths/export.sh@5 -- # export PATH 00:18:53.438 15:19:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:53.438 15:19:57 -- nvmf/common.sh@47 -- # : 0 00:18:53.438 15:19:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:53.438 15:19:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:53.438 15:19:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:53.438 15:19:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:53.438 15:19:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:53.438 15:19:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:53.438 15:19:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:53.438 15:19:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:53.438 15:19:57 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:53.438 15:19:57 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:53.438 15:19:57 -- target/nmic.sh@14 -- # nvmftestinit 00:18:53.438 15:19:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:53.438 15:19:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:53.438 15:19:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:53.438 15:19:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:53.438 15:19:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:53.438 15:19:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.438 15:19:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.438 15:19:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:53.438 15:19:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:53.438 15:19:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:53.438 15:19:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:53.438 15:19:57 -- common/autotest_common.sh@10 -- # set +x 00:19:01.564 15:20:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:01.564 15:20:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:01.564 15:20:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:01.564 15:20:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:01.564 15:20:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:01.564 15:20:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:01.564 15:20:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:01.564 15:20:04 -- nvmf/common.sh@295 -- # net_devs=() 00:19:01.564 15:20:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:01.564 15:20:04 -- nvmf/common.sh@296 -- # e810=() 00:19:01.564 15:20:04 -- nvmf/common.sh@296 -- # local -ga e810 00:19:01.564 15:20:04 -- nvmf/common.sh@297 -- # x722=() 00:19:01.564 15:20:04 -- nvmf/common.sh@297 -- # local -ga x722 00:19:01.564 15:20:04 -- nvmf/common.sh@298 -- # mlx=() 00:19:01.564 15:20:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:01.564 15:20:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:01.564 15:20:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:01.564 15:20:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:01.564 15:20:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:01.564 15:20:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:01.565 15:20:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:19:01.565 Found 0000:18:00.0 (0x8086 - 0x1592) 00:19:01.565 15:20:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:01.565 15:20:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:19:01.565 Found 0000:18:00.1 (0x8086 - 0x1592) 00:19:01.565 15:20:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:01.565 15:20:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@377 -- # modinfo irdma 00:19:01.565 15:20:04 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:19:01.565 15:20:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.565 15:20:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.565 15:20:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:19:01.565 Found net devices under 0000:18:00.0: cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.565 15:20:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.565 15:20:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:19:01.565 Found net devices under 0000:18:00.1: cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.565 15:20:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:01.565 15:20:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:01.565 15:20:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:01.565 15:20:04 -- nvmf/common.sh@58 -- # uname 00:19:01.565 15:20:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:01.565 15:20:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:01.565 15:20:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:01.565 15:20:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:01.565 15:20:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:01.565 15:20:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:01.565 15:20:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:01.565 15:20:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:01.565 15:20:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:01.565 15:20:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:01.565 15:20:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:01.565 15:20:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:01.565 15:20:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:01.565 15:20:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:01.565 15:20:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:01.565 15:20:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@105 -- # continue 2 00:19:01.565 15:20:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@105 -- # continue 2 00:19:01.565 15:20:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:01.565 15:20:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.565 15:20:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:01.565 15:20:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:19:01.565 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:01.565 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:19:01.565 altname enp24s0f0np0 00:19:01.565 altname ens785f0np0 00:19:01.565 inet 192.168.100.8/24 scope global cvl_0_0 00:19:01.565 valid_lft forever preferred_lft forever 00:19:01.565 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:19:01.565 valid_lft forever preferred_lft forever 00:19:01.565 15:20:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:01.565 15:20:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.565 15:20:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:01.565 15:20:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:19:01.565 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:01.565 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:19:01.565 altname enp24s0f1np1 00:19:01.565 altname ens785f1np1 00:19:01.565 inet 192.168.100.9/24 scope global cvl_0_1 00:19:01.565 valid_lft forever preferred_lft forever 00:19:01.565 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:19:01.565 valid_lft forever preferred_lft forever 00:19:01.565 15:20:04 -- nvmf/common.sh@411 -- # return 0 00:19:01.565 15:20:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:01.565 15:20:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:01.565 15:20:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:01.565 15:20:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:01.565 15:20:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:01.565 15:20:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:01.565 15:20:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:01.565 15:20:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:01.565 15:20:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:01.565 15:20:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@105 -- # continue 2 00:19:01.565 15:20:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.565 15:20:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:01.565 15:20:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@105 -- # continue 2 00:19:01.565 15:20:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:01.565 15:20:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.565 15:20:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:01.565 15:20:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.565 15:20:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.565 15:20:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:01.566 192.168.100.9' 00:19:01.566 15:20:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:01.566 192.168.100.9' 00:19:01.566 15:20:04 -- nvmf/common.sh@446 -- # head -n 1 00:19:01.566 15:20:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:01.566 15:20:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:01.566 192.168.100.9' 00:19:01.566 15:20:04 -- nvmf/common.sh@447 -- # head -n 1 00:19:01.566 15:20:04 -- nvmf/common.sh@447 -- # tail -n +2 00:19:01.566 15:20:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:01.566 15:20:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:01.566 15:20:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:01.566 15:20:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:01.566 15:20:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:01.566 15:20:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:01.566 15:20:04 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:01.566 15:20:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:01.566 15:20:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:01.566 15:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:01.566 15:20:04 -- nvmf/common.sh@470 -- # nvmfpid=656997 00:19:01.566 15:20:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:01.566 15:20:04 -- nvmf/common.sh@471 -- # waitforlisten 656997 00:19:01.566 15:20:04 -- common/autotest_common.sh@817 -- # '[' -z 656997 ']' 00:19:01.566 15:20:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:01.566 15:20:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:01.566 15:20:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:01.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:01.566 15:20:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:01.566 15:20:04 -- common/autotest_common.sh@10 -- # set +x 00:19:01.566 [2024-04-24 15:20:04.988179] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:19:01.566 [2024-04-24 15:20:04.988233] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:01.566 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.566 [2024-04-24 15:20:05.068874] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:01.566 [2024-04-24 15:20:05.155882] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:01.566 [2024-04-24 15:20:05.155919] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:01.566 [2024-04-24 15:20:05.155929] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:01.566 [2024-04-24 15:20:05.155939] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:01.566 [2024-04-24 15:20:05.155946] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:01.566 [2024-04-24 15:20:05.155997] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:01.566 [2024-04-24 15:20:05.156079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:01.566 [2024-04-24 15:20:05.156153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:01.566 [2024-04-24 15:20:05.156155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:02.135 15:20:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:02.135 15:20:05 -- common/autotest_common.sh@850 -- # return 0 00:19:02.135 15:20:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:02.135 15:20:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 15:20:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:02.135 15:20:05 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 [2024-04-24 15:20:05.869830] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1842910/0x1841f50) succeed. 00:19:02.135 [2024-04-24 15:20:05.880527] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1843c80/0x18424d0) succeed. 00:19:02.135 [2024-04-24 15:20:05.880554] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 Malloc0 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 [2024-04-24 15:20:05.936163] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:02.135 test case1: single bdev can't be used in multiple subsystems 00:19:02.135 15:20:05 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@28 -- # nmic_status=0 00:19:02.135 15:20:05 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 [2024-04-24 15:20:05.960189] bdev.c:7988:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:02.135 [2024-04-24 15:20:05.960209] subsystem.c:1934:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:02.135 [2024-04-24 15:20:05.960219] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.135 request: 00:19:02.135 { 00:19:02.135 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:02.135 "namespace": { 00:19:02.135 "bdev_name": "Malloc0", 00:19:02.135 "no_auto_visible": false 00:19:02.135 }, 00:19:02.135 "method": "nvmf_subsystem_add_ns", 00:19:02.135 "req_id": 1 00:19:02.135 } 00:19:02.135 Got JSON-RPC error response 00:19:02.135 response: 00:19:02.135 { 00:19:02.135 "code": -32602, 00:19:02.135 "message": "Invalid parameters" 00:19:02.135 } 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@29 -- # nmic_status=1 00:19:02.135 15:20:05 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:02.135 15:20:05 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:02.135 Adding namespace failed - expected result. 00:19:02.135 15:20:05 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:02.135 test case2: host connect to nvmf target in multiple paths 00:19:02.135 15:20:05 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:19:02.135 15:20:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:02.135 15:20:05 -- common/autotest_common.sh@10 -- # set +x 00:19:02.135 [2024-04-24 15:20:05.976274] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:02.135 15:20:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:02.135 15:20:05 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:02.394 15:20:06 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:19:02.654 15:20:06 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:02.654 15:20:06 -- common/autotest_common.sh@1184 -- # local i=0 00:19:02.654 15:20:06 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:02.654 15:20:06 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:19:02.654 15:20:06 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:04.557 15:20:08 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:04.557 15:20:08 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:04.557 15:20:08 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:04.557 15:20:08 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:19:04.557 15:20:08 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:04.557 15:20:08 -- common/autotest_common.sh@1194 -- # return 0 00:19:04.557 15:20:08 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:04.557 [global] 00:19:04.557 thread=1 00:19:04.557 invalidate=1 00:19:04.557 rw=write 00:19:04.557 time_based=1 00:19:04.557 runtime=1 00:19:04.557 ioengine=libaio 00:19:04.557 direct=1 00:19:04.557 bs=4096 00:19:04.557 iodepth=1 00:19:04.557 norandommap=0 00:19:04.557 numjobs=1 00:19:04.557 00:19:04.557 verify_dump=1 00:19:04.557 verify_backlog=512 00:19:04.557 verify_state_save=0 00:19:04.557 do_verify=1 00:19:04.557 verify=crc32c-intel 00:19:04.557 [job0] 00:19:04.557 filename=/dev/nvme0n1 00:19:04.814 Could not set queue depth (nvme0n1) 00:19:05.072 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:05.072 fio-3.35 00:19:05.072 Starting 1 thread 00:19:06.007 00:19:06.007 job0: (groupid=0, jobs=1): err= 0: pid=657656: Wed Apr 24 15:20:09 2024 00:19:06.007 read: IOPS=6144, BW=24.0MiB/s (25.2MB/s)(24.0MiB/1000msec) 00:19:06.007 slat (nsec): min=8633, max=27096, avg=9345.27, stdev=912.99 00:19:06.007 clat (nsec): min=44105, max=87366, avg=67154.00, stdev=3707.31 00:19:06.007 lat (usec): min=67, max=107, avg=76.50, stdev= 3.79 00:19:06.007 clat percentiles (nsec): 00:19:06.007 | 1.00th=[60160], 5.00th=[61696], 10.00th=[62720], 20.00th=[63744], 00:19:06.007 | 30.00th=[64768], 40.00th=[66048], 50.00th=[67072], 60.00th=[68096], 00:19:06.007 | 70.00th=[69120], 80.00th=[70144], 90.00th=[72192], 95.00th=[73216], 00:19:06.007 | 99.00th=[76288], 99.50th=[78336], 99.90th=[83456], 99.95th=[85504], 00:19:06.007 | 99.99th=[87552] 00:19:06.007 write: IOPS=6536, BW=25.5MiB/s (26.8MB/s)(25.5MiB/1000msec); 0 zone resets 00:19:06.007 slat (nsec): min=10931, max=47432, avg=11860.94, stdev=1091.44 00:19:06.007 clat (nsec): min=51491, max=86612, avg=65251.25, stdev=3769.19 00:19:06.007 lat (usec): min=67, max=131, avg=77.11, stdev= 3.92 00:19:06.007 clat percentiles (nsec): 00:19:06.007 | 1.00th=[58112], 5.00th=[59648], 10.00th=[60672], 20.00th=[62208], 00:19:06.007 | 30.00th=[63232], 40.00th=[64256], 50.00th=[64768], 60.00th=[66048], 00:19:06.008 | 70.00th=[67072], 80.00th=[68096], 90.00th=[70144], 95.00th=[71168], 00:19:06.008 | 99.00th=[75264], 99.50th=[76288], 99.90th=[82432], 99.95th=[84480], 00:19:06.008 | 99.99th=[86528] 00:19:06.008 bw ( KiB/s): min=25896, max=25896, per=99.05%, avg=25896.00, stdev= 0.00, samples=1 00:19:06.008 iops : min= 6474, max= 6474, avg=6474.00, stdev= 0.00, samples=1 00:19:06.008 lat (usec) : 50=0.01%, 100=99.99% 00:19:06.008 cpu : usr=7.20%, sys=14.30%, ctx=12680, majf=0, minf=1 00:19:06.008 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:06.008 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.008 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.008 issued rwts: total=6144,6536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.008 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:06.008 00:19:06.008 Run status group 0 (all jobs): 00:19:06.008 READ: bw=24.0MiB/s (25.2MB/s), 24.0MiB/s-24.0MiB/s (25.2MB/s-25.2MB/s), io=24.0MiB (25.2MB), run=1000-1000msec 00:19:06.008 WRITE: bw=25.5MiB/s (26.8MB/s), 25.5MiB/s-25.5MiB/s (26.8MB/s-26.8MB/s), io=25.5MiB (26.8MB), run=1000-1000msec 00:19:06.008 00:19:06.008 Disk stats (read/write): 00:19:06.008 nvme0n1: ios=5682/5765, merge=0/0, ticks=357/364, in_queue=721, util=90.98% 00:19:06.008 15:20:09 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:07.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:07.910 15:20:11 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:07.910 15:20:11 -- common/autotest_common.sh@1205 -- # local i=0 00:19:07.910 15:20:11 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:07.910 15:20:11 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:07.910 15:20:11 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:07.910 15:20:11 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:07.910 15:20:11 -- common/autotest_common.sh@1217 -- # return 0 00:19:07.910 15:20:11 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:07.910 15:20:11 -- target/nmic.sh@53 -- # nvmftestfini 00:19:07.910 15:20:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:07.911 15:20:11 -- nvmf/common.sh@117 -- # sync 00:19:07.911 15:20:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:07.911 15:20:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:07.911 15:20:11 -- nvmf/common.sh@120 -- # set +e 00:19:07.911 15:20:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:07.911 15:20:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:07.911 rmmod nvme_rdma 00:19:07.911 rmmod nvme_fabrics 00:19:07.911 15:20:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:07.911 15:20:11 -- nvmf/common.sh@124 -- # set -e 00:19:07.911 15:20:11 -- nvmf/common.sh@125 -- # return 0 00:19:07.911 15:20:11 -- nvmf/common.sh@478 -- # '[' -n 656997 ']' 00:19:07.911 15:20:11 -- nvmf/common.sh@479 -- # killprocess 656997 00:19:07.911 15:20:11 -- common/autotest_common.sh@936 -- # '[' -z 656997 ']' 00:19:07.911 15:20:11 -- common/autotest_common.sh@940 -- # kill -0 656997 00:19:07.911 15:20:11 -- common/autotest_common.sh@941 -- # uname 00:19:07.911 15:20:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:07.911 15:20:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 656997 00:19:07.911 15:20:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:07.911 15:20:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:07.911 15:20:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 656997' 00:19:07.911 killing process with pid 656997 00:19:07.911 15:20:11 -- common/autotest_common.sh@955 -- # kill 656997 00:19:07.911 15:20:11 -- common/autotest_common.sh@960 -- # wait 656997 00:19:07.911 [2024-04-24 15:20:11.767258] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:08.170 15:20:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:08.170 15:20:12 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:08.170 00:19:08.170 real 0m15.032s 00:19:08.170 user 0m32.487s 00:19:08.170 sys 0m6.940s 00:19:08.170 15:20:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:08.170 15:20:12 -- common/autotest_common.sh@10 -- # set +x 00:19:08.170 ************************************ 00:19:08.170 END TEST nvmf_nmic 00:19:08.170 ************************************ 00:19:08.170 15:20:12 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:08.170 15:20:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:08.170 15:20:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:08.170 15:20:12 -- common/autotest_common.sh@10 -- # set +x 00:19:08.428 ************************************ 00:19:08.428 START TEST nvmf_fio_target 00:19:08.428 ************************************ 00:19:08.428 15:20:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:08.428 * Looking for test storage... 00:19:08.428 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:19:08.428 15:20:12 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:19:08.428 15:20:12 -- nvmf/common.sh@7 -- # uname -s 00:19:08.428 15:20:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:08.428 15:20:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:08.428 15:20:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:08.428 15:20:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:08.428 15:20:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:08.428 15:20:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:08.428 15:20:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:08.428 15:20:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:08.429 15:20:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:08.429 15:20:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:08.429 15:20:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:19:08.429 15:20:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:19:08.429 15:20:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:08.429 15:20:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:08.429 15:20:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:08.429 15:20:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:08.429 15:20:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:19:08.429 15:20:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:08.429 15:20:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:08.429 15:20:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:08.429 15:20:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.429 15:20:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.429 15:20:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.429 15:20:12 -- paths/export.sh@5 -- # export PATH 00:19:08.429 15:20:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:08.429 15:20:12 -- nvmf/common.sh@47 -- # : 0 00:19:08.429 15:20:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:08.429 15:20:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:08.429 15:20:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:08.429 15:20:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:08.429 15:20:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:08.429 15:20:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:08.429 15:20:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:08.429 15:20:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:08.687 15:20:12 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:08.687 15:20:12 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:08.687 15:20:12 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:19:08.687 15:20:12 -- target/fio.sh@16 -- # nvmftestinit 00:19:08.687 15:20:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:08.687 15:20:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:08.687 15:20:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:08.687 15:20:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:08.687 15:20:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:08.687 15:20:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:08.687 15:20:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:08.687 15:20:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:08.687 15:20:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:08.687 15:20:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:08.687 15:20:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:08.687 15:20:12 -- common/autotest_common.sh@10 -- # set +x 00:19:15.255 15:20:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:15.255 15:20:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:15.255 15:20:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:15.255 15:20:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:15.255 15:20:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:15.255 15:20:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:15.255 15:20:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:15.255 15:20:19 -- nvmf/common.sh@295 -- # net_devs=() 00:19:15.255 15:20:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:15.255 15:20:19 -- nvmf/common.sh@296 -- # e810=() 00:19:15.255 15:20:19 -- nvmf/common.sh@296 -- # local -ga e810 00:19:15.255 15:20:19 -- nvmf/common.sh@297 -- # x722=() 00:19:15.255 15:20:19 -- nvmf/common.sh@297 -- # local -ga x722 00:19:15.255 15:20:19 -- nvmf/common.sh@298 -- # mlx=() 00:19:15.255 15:20:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:15.255 15:20:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:15.255 15:20:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:15.255 15:20:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:19:15.255 Found 0000:18:00.0 (0x8086 - 0x1592) 00:19:15.255 15:20:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:15.255 15:20:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:15.255 15:20:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:19:15.255 Found 0000:18:00.1 (0x8086 - 0x1592) 00:19:15.255 15:20:19 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:15.255 15:20:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@377 -- # modinfo irdma 00:19:15.255 15:20:19 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:19:15.255 15:20:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:15.255 15:20:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.255 15:20:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.255 15:20:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:19:15.255 Found net devices under 0000:18:00.0: cvl_0_0 00:19:15.255 15:20:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:15.255 15:20:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.255 15:20:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.255 15:20:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:19:15.255 Found net devices under 0000:18:00.1: cvl_0_1 00:19:15.255 15:20:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.255 15:20:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:15.255 15:20:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:15.255 15:20:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:15.255 15:20:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:15.255 15:20:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:15.255 15:20:19 -- nvmf/common.sh@58 -- # uname 00:19:15.255 15:20:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:15.255 15:20:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:15.255 15:20:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:15.255 15:20:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:15.255 15:20:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:15.255 15:20:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:15.255 15:20:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:15.256 15:20:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:15.256 15:20:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:15.256 15:20:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:15.256 15:20:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:15.256 15:20:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:15.256 15:20:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:15.256 15:20:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:15.256 15:20:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:15.256 15:20:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:15.256 15:20:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.256 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.256 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:15.256 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.256 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:15.256 15:20:19 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:15.256 15:20:19 -- nvmf/common.sh@105 -- # continue 2 00:19:15.256 15:20:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.256 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.256 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:15.256 15:20:19 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:15.256 15:20:19 -- nvmf/common.sh@105 -- # continue 2 00:19:15.256 15:20:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:15.256 15:20:19 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:19:15.256 15:20:19 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.256 15:20:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:15.256 15:20:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:15.256 15:20:19 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:19:15.256 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:15.256 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:19:15.256 altname enp24s0f0np0 00:19:15.256 altname ens785f0np0 00:19:15.256 inet 192.168.100.8/24 scope global cvl_0_0 00:19:15.256 valid_lft forever preferred_lft forever 00:19:15.256 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:19:15.256 valid_lft forever preferred_lft forever 00:19:15.256 15:20:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:15.256 15:20:19 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:19:15.256 15:20:19 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.256 15:20:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.516 15:20:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:15.516 15:20:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:15.516 15:20:19 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:19:15.516 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:15.516 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:19:15.516 altname enp24s0f1np1 00:19:15.516 altname ens785f1np1 00:19:15.516 inet 192.168.100.9/24 scope global cvl_0_1 00:19:15.516 valid_lft forever preferred_lft forever 00:19:15.516 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:19:15.516 valid_lft forever preferred_lft forever 00:19:15.516 15:20:19 -- nvmf/common.sh@411 -- # return 0 00:19:15.516 15:20:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:15.516 15:20:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:15.516 15:20:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:15.516 15:20:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:15.516 15:20:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:15.516 15:20:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:15.516 15:20:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:15.516 15:20:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:15.516 15:20:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:15.516 15:20:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:15.516 15:20:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.516 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.516 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:15.516 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.516 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:15.516 15:20:19 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:15.516 15:20:19 -- nvmf/common.sh@105 -- # continue 2 00:19:15.516 15:20:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.516 15:20:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.516 15:20:19 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:15.516 15:20:19 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:15.516 15:20:19 -- nvmf/common.sh@105 -- # continue 2 00:19:15.516 15:20:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:15.516 15:20:19 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:19:15.516 15:20:19 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.516 15:20:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:15.516 15:20:19 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:19:15.516 15:20:19 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:15.516 15:20:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.516 15:20:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:15.516 192.168.100.9' 00:19:15.516 15:20:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:15.516 192.168.100.9' 00:19:15.516 15:20:19 -- nvmf/common.sh@446 -- # head -n 1 00:19:15.516 15:20:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:15.516 15:20:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:15.516 192.168.100.9' 00:19:15.516 15:20:19 -- nvmf/common.sh@447 -- # tail -n +2 00:19:15.516 15:20:19 -- nvmf/common.sh@447 -- # head -n 1 00:19:15.516 15:20:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:15.516 15:20:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:15.516 15:20:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:15.516 15:20:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:15.516 15:20:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:15.516 15:20:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:15.516 15:20:19 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:15.516 15:20:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:15.516 15:20:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:15.516 15:20:19 -- common/autotest_common.sh@10 -- # set +x 00:19:15.516 15:20:19 -- nvmf/common.sh@470 -- # nvmfpid=661381 00:19:15.516 15:20:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:15.516 15:20:19 -- nvmf/common.sh@471 -- # waitforlisten 661381 00:19:15.516 15:20:19 -- common/autotest_common.sh@817 -- # '[' -z 661381 ']' 00:19:15.516 15:20:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:15.516 15:20:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:15.516 15:20:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:15.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:15.516 15:20:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:15.516 15:20:19 -- common/autotest_common.sh@10 -- # set +x 00:19:15.516 [2024-04-24 15:20:19.331141] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:19:15.516 [2024-04-24 15:20:19.331194] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:15.516 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.516 [2024-04-24 15:20:19.412791] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:15.776 [2024-04-24 15:20:19.497692] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:15.776 [2024-04-24 15:20:19.497736] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:15.776 [2024-04-24 15:20:19.497745] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:15.776 [2024-04-24 15:20:19.497754] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:15.776 [2024-04-24 15:20:19.497761] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:15.776 [2024-04-24 15:20:19.497823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:15.776 [2024-04-24 15:20:19.497906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:15.776 [2024-04-24 15:20:19.497926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:15.776 [2024-04-24 15:20:19.497931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:16.344 15:20:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:16.344 15:20:20 -- common/autotest_common.sh@850 -- # return 0 00:19:16.344 15:20:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:16.344 15:20:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:16.344 15:20:20 -- common/autotest_common.sh@10 -- # set +x 00:19:16.344 15:20:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:16.344 15:20:20 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:16.603 [2024-04-24 15:20:20.373356] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x230c910/0x230bf50) succeed. 00:19:16.603 [2024-04-24 15:20:20.383910] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x230dc80/0x230c4d0) succeed. 00:19:16.603 [2024-04-24 15:20:20.383936] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:19:16.603 15:20:20 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:16.862 15:20:20 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:16.863 15:20:20 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:17.206 15:20:20 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:17.206 15:20:20 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:17.206 15:20:21 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:17.206 15:20:21 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:17.465 15:20:21 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:17.465 15:20:21 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:17.725 15:20:21 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:17.725 15:20:21 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:17.725 15:20:21 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:17.984 15:20:21 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:17.984 15:20:21 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:18.244 15:20:22 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:18.244 15:20:22 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:18.503 15:20:22 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:18.503 15:20:22 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:18.503 15:20:22 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:18.762 15:20:22 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:18.762 15:20:22 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:19.019 15:20:22 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:19.019 [2024-04-24 15:20:22.900947] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:19.019 15:20:22 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:19.277 15:20:23 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:19.536 15:20:23 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:19.795 15:20:23 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:19.795 15:20:23 -- common/autotest_common.sh@1184 -- # local i=0 00:19:19.795 15:20:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.795 15:20:23 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:19:19.795 15:20:23 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:19:19.795 15:20:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:21.698 15:20:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:21.698 15:20:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:21.698 15:20:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:21.698 15:20:25 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:19:21.698 15:20:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:21.698 15:20:25 -- common/autotest_common.sh@1194 -- # return 0 00:19:21.698 15:20:25 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:21.698 [global] 00:19:21.698 thread=1 00:19:21.698 invalidate=1 00:19:21.698 rw=write 00:19:21.698 time_based=1 00:19:21.698 runtime=1 00:19:21.698 ioengine=libaio 00:19:21.698 direct=1 00:19:21.698 bs=4096 00:19:21.698 iodepth=1 00:19:21.698 norandommap=0 00:19:21.698 numjobs=1 00:19:21.698 00:19:21.698 verify_dump=1 00:19:21.698 verify_backlog=512 00:19:21.698 verify_state_save=0 00:19:21.698 do_verify=1 00:19:21.698 verify=crc32c-intel 00:19:21.698 [job0] 00:19:21.698 filename=/dev/nvme0n1 00:19:21.698 [job1] 00:19:21.698 filename=/dev/nvme0n2 00:19:21.698 [job2] 00:19:21.698 filename=/dev/nvme0n3 00:19:21.698 [job3] 00:19:21.698 filename=/dev/nvme0n4 00:19:21.956 Could not set queue depth (nvme0n1) 00:19:21.956 Could not set queue depth (nvme0n2) 00:19:21.956 Could not set queue depth (nvme0n3) 00:19:21.956 Could not set queue depth (nvme0n4) 00:19:22.213 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.213 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.213 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.213 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:22.213 fio-3.35 00:19:22.213 Starting 4 threads 00:19:23.583 00:19:23.583 job0: (groupid=0, jobs=1): err= 0: pid=662381: Wed Apr 24 15:20:27 2024 00:19:23.583 read: IOPS=4226, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1001msec) 00:19:23.583 slat (nsec): min=8537, max=25852, avg=9245.28, stdev=896.64 00:19:23.583 clat (usec): min=73, max=187, avg=103.85, stdev=20.54 00:19:23.583 lat (usec): min=82, max=197, avg=113.09, stdev=20.64 00:19:23.583 clat percentiles (usec): 00:19:23.583 | 1.00th=[ 78], 5.00th=[ 81], 10.00th=[ 83], 20.00th=[ 85], 00:19:23.583 | 30.00th=[ 87], 40.00th=[ 90], 50.00th=[ 94], 60.00th=[ 113], 00:19:23.583 | 70.00th=[ 122], 80.00th=[ 127], 90.00th=[ 133], 95.00th=[ 137], 00:19:23.583 | 99.00th=[ 147], 99.50th=[ 149], 99.90th=[ 159], 99.95th=[ 159], 00:19:23.583 | 99.99th=[ 188] 00:19:23.583 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:23.583 slat (nsec): min=10660, max=52183, avg=11576.61, stdev=1315.87 00:19:23.583 clat (usec): min=64, max=156, avg=97.63, stdev=18.19 00:19:23.583 lat (usec): min=82, max=168, avg=109.21, stdev=18.27 00:19:23.583 clat percentiles (usec): 00:19:23.583 | 1.00th=[ 74], 5.00th=[ 77], 10.00th=[ 79], 20.00th=[ 81], 00:19:23.583 | 30.00th=[ 84], 40.00th=[ 86], 50.00th=[ 90], 60.00th=[ 103], 00:19:23.583 | 70.00th=[ 112], 80.00th=[ 118], 90.00th=[ 124], 95.00th=[ 129], 00:19:23.583 | 99.00th=[ 137], 99.50th=[ 141], 99.90th=[ 149], 99.95th=[ 151], 00:19:23.583 | 99.99th=[ 157] 00:19:23.583 bw ( KiB/s): min=20480, max=20480, per=28.89%, avg=20480.00, stdev= 0.00, samples=1 00:19:23.583 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:23.583 lat (usec) : 100=56.39%, 250=43.61% 00:19:23.583 cpu : usr=5.50%, sys=9.50%, ctx=8839, majf=0, minf=1 00:19:23.583 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.583 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.583 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.583 issued rwts: total=4231,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.583 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.583 job1: (groupid=0, jobs=1): err= 0: pid=662397: Wed Apr 24 15:20:27 2024 00:19:23.583 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:23.583 slat (nsec): min=9200, max=27479, avg=9771.28, stdev=918.17 00:19:23.583 clat (usec): min=72, max=163, avg=94.39, stdev=15.21 00:19:23.583 lat (usec): min=82, max=172, avg=104.16, stdev=15.27 00:19:23.583 clat percentiles (usec): 00:19:23.583 | 1.00th=[ 78], 5.00th=[ 81], 10.00th=[ 82], 20.00th=[ 84], 00:19:23.583 | 30.00th=[ 86], 40.00th=[ 87], 50.00th=[ 89], 60.00th=[ 91], 00:19:23.583 | 70.00th=[ 94], 80.00th=[ 105], 90.00th=[ 122], 95.00th=[ 128], 00:19:23.583 | 99.00th=[ 139], 99.50th=[ 141], 99.90th=[ 149], 99.95th=[ 153], 00:19:23.583 | 99.99th=[ 163] 00:19:23.583 write: IOPS=4690, BW=18.3MiB/s (19.2MB/s)(18.3MiB/1001msec); 0 zone resets 00:19:23.583 slat (nsec): min=10776, max=44545, avg=12704.18, stdev=1246.81 00:19:23.583 clat (usec): min=67, max=186, avg=92.30, stdev=15.70 00:19:23.583 lat (usec): min=82, max=197, avg=105.00, stdev=15.77 00:19:23.583 clat percentiles (usec): 00:19:23.583 | 1.00th=[ 75], 5.00th=[ 78], 10.00th=[ 79], 20.00th=[ 81], 00:19:23.583 | 30.00th=[ 83], 40.00th=[ 85], 50.00th=[ 86], 60.00th=[ 89], 00:19:23.583 | 70.00th=[ 93], 80.00th=[ 109], 90.00th=[ 120], 95.00th=[ 126], 00:19:23.584 | 99.00th=[ 135], 99.50th=[ 139], 99.90th=[ 147], 99.95th=[ 149], 00:19:23.584 | 99.99th=[ 186] 00:19:23.584 bw ( KiB/s): min=20480, max=20480, per=28.89%, avg=20480.00, stdev= 0.00, samples=1 00:19:23.584 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:23.584 lat (usec) : 100=76.88%, 250=23.12% 00:19:23.584 cpu : usr=6.90%, sys=10.40%, ctx=9303, majf=0, minf=1 00:19:23.584 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 issued rwts: total=4608,4695,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.584 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.584 job2: (groupid=0, jobs=1): err= 0: pid=662415: Wed Apr 24 15:20:27 2024 00:19:23.584 read: IOPS=4276, BW=16.7MiB/s (17.5MB/s)(16.7MiB/1001msec) 00:19:23.584 slat (nsec): min=8697, max=26745, avg=9554.89, stdev=1012.91 00:19:23.584 clat (usec): min=78, max=161, avg=101.32, stdev=14.40 00:19:23.584 lat (usec): min=88, max=171, avg=110.88, stdev=14.40 00:19:23.584 clat percentiles (usec): 00:19:23.584 | 1.00th=[ 84], 5.00th=[ 87], 10.00th=[ 89], 20.00th=[ 91], 00:19:23.584 | 30.00th=[ 93], 40.00th=[ 95], 50.00th=[ 97], 60.00th=[ 99], 00:19:23.584 | 70.00th=[ 102], 80.00th=[ 110], 90.00th=[ 127], 95.00th=[ 135], 00:19:23.584 | 99.00th=[ 143], 99.50th=[ 147], 99.90th=[ 155], 99.95th=[ 159], 00:19:23.584 | 99.99th=[ 161] 00:19:23.584 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:23.584 slat (nsec): min=10834, max=49832, avg=11794.07, stdev=1214.21 00:19:23.584 clat (usec): min=70, max=160, avg=98.15, stdev=13.86 00:19:23.584 lat (usec): min=88, max=189, avg=109.94, stdev=13.85 00:19:23.584 clat percentiles (usec): 00:19:23.584 | 1.00th=[ 81], 5.00th=[ 84], 10.00th=[ 86], 20.00th=[ 88], 00:19:23.584 | 30.00th=[ 90], 40.00th=[ 91], 50.00th=[ 93], 60.00th=[ 96], 00:19:23.584 | 70.00th=[ 100], 80.00th=[ 113], 90.00th=[ 122], 95.00th=[ 127], 00:19:23.584 | 99.00th=[ 137], 99.50th=[ 139], 99.90th=[ 143], 99.95th=[ 151], 00:19:23.584 | 99.99th=[ 161] 00:19:23.584 bw ( KiB/s): min=17376, max=17376, per=24.51%, avg=17376.00, stdev= 0.00, samples=1 00:19:23.584 iops : min= 4344, max= 4344, avg=4344.00, stdev= 0.00, samples=1 00:19:23.584 lat (usec) : 100=67.80%, 250=32.20% 00:19:23.584 cpu : usr=4.80%, sys=10.50%, ctx=8889, majf=0, minf=1 00:19:23.584 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 issued rwts: total=4281,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.584 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.584 job3: (groupid=0, jobs=1): err= 0: pid=662421: Wed Apr 24 15:20:27 2024 00:19:23.584 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:19:23.584 slat (nsec): min=8708, max=33455, avg=9590.89, stdev=1305.01 00:19:23.584 clat (usec): min=97, max=228, avg=125.19, stdev= 9.10 00:19:23.584 lat (usec): min=106, max=238, avg=134.78, stdev= 9.17 00:19:23.584 clat percentiles (usec): 00:19:23.584 | 1.00th=[ 106], 5.00th=[ 112], 10.00th=[ 115], 20.00th=[ 118], 00:19:23.584 | 30.00th=[ 121], 40.00th=[ 123], 50.00th=[ 126], 60.00th=[ 128], 00:19:23.584 | 70.00th=[ 130], 80.00th=[ 133], 90.00th=[ 137], 95.00th=[ 141], 00:19:23.584 | 99.00th=[ 147], 99.50th=[ 153], 99.90th=[ 182], 99.95th=[ 210], 00:19:23.584 | 99.99th=[ 229] 00:19:23.584 write: IOPS=3828, BW=15.0MiB/s (15.7MB/s)(15.0MiB/1001msec); 0 zone resets 00:19:23.584 slat (nsec): min=10781, max=44198, avg=11998.97, stdev=1541.25 00:19:23.584 clat (usec): min=77, max=188, avg=118.80, stdev= 8.72 00:19:23.584 lat (usec): min=88, max=200, avg=130.80, stdev= 8.78 00:19:23.584 clat percentiles (usec): 00:19:23.584 | 1.00th=[ 100], 5.00th=[ 105], 10.00th=[ 109], 20.00th=[ 112], 00:19:23.584 | 30.00th=[ 115], 40.00th=[ 117], 50.00th=[ 119], 60.00th=[ 121], 00:19:23.584 | 70.00th=[ 123], 80.00th=[ 126], 90.00th=[ 130], 95.00th=[ 133], 00:19:23.584 | 99.00th=[ 141], 99.50th=[ 145], 99.90th=[ 157], 99.95th=[ 174], 00:19:23.584 | 99.99th=[ 190] 00:19:23.584 bw ( KiB/s): min=16384, max=16384, per=23.11%, avg=16384.00, stdev= 0.00, samples=1 00:19:23.584 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:23.584 lat (usec) : 100=0.63%, 250=99.37% 00:19:23.584 cpu : usr=4.40%, sys=8.60%, ctx=7416, majf=0, minf=1 00:19:23.584 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.584 issued rwts: total=3584,3832,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.584 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.584 00:19:23.584 Run status group 0 (all jobs): 00:19:23.584 READ: bw=65.2MiB/s (68.4MB/s), 14.0MiB/s-18.0MiB/s (14.7MB/s-18.9MB/s), io=65.2MiB (68.4MB), run=1001-1001msec 00:19:23.584 WRITE: bw=69.2MiB/s (72.6MB/s), 15.0MiB/s-18.3MiB/s (15.7MB/s-19.2MB/s), io=69.3MiB (72.7MB), run=1001-1001msec 00:19:23.584 00:19:23.584 Disk stats (read/write): 00:19:23.584 nvme0n1: ios=3634/3840, merge=0/0, ticks=380/349, in_queue=729, util=85.67% 00:19:23.584 nvme0n2: ios=3918/4096, merge=0/0, ticks=343/332, in_queue=675, util=86.16% 00:19:23.584 nvme0n3: ios=3584/3875, merge=0/0, ticks=346/355, in_queue=701, util=88.78% 00:19:23.584 nvme0n4: ios=3072/3188, merge=0/0, ticks=368/350, in_queue=718, util=89.74% 00:19:23.584 15:20:27 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:23.584 [global] 00:19:23.584 thread=1 00:19:23.584 invalidate=1 00:19:23.584 rw=randwrite 00:19:23.584 time_based=1 00:19:23.584 runtime=1 00:19:23.584 ioengine=libaio 00:19:23.584 direct=1 00:19:23.584 bs=4096 00:19:23.584 iodepth=1 00:19:23.584 norandommap=0 00:19:23.584 numjobs=1 00:19:23.584 00:19:23.584 verify_dump=1 00:19:23.584 verify_backlog=512 00:19:23.584 verify_state_save=0 00:19:23.584 do_verify=1 00:19:23.584 verify=crc32c-intel 00:19:23.584 [job0] 00:19:23.584 filename=/dev/nvme0n1 00:19:23.584 [job1] 00:19:23.584 filename=/dev/nvme0n2 00:19:23.584 [job2] 00:19:23.584 filename=/dev/nvme0n3 00:19:23.584 [job3] 00:19:23.584 filename=/dev/nvme0n4 00:19:23.584 Could not set queue depth (nvme0n1) 00:19:23.584 Could not set queue depth (nvme0n2) 00:19:23.584 Could not set queue depth (nvme0n3) 00:19:23.584 Could not set queue depth (nvme0n4) 00:19:23.584 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:23.584 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:23.584 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:23.584 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:23.584 fio-3.35 00:19:23.584 Starting 4 threads 00:19:24.955 00:19:24.955 job0: (groupid=0, jobs=1): err= 0: pid=662729: Wed Apr 24 15:20:28 2024 00:19:24.955 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:24.955 slat (nsec): min=8586, max=33246, avg=9333.92, stdev=978.44 00:19:24.955 clat (usec): min=72, max=144, avg=99.10, stdev=15.74 00:19:24.955 lat (usec): min=81, max=153, avg=108.43, stdev=15.76 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 78], 5.00th=[ 81], 10.00th=[ 82], 20.00th=[ 85], 00:19:24.955 | 30.00th=[ 87], 40.00th=[ 90], 50.00th=[ 93], 60.00th=[ 103], 00:19:24.955 | 70.00th=[ 112], 80.00th=[ 118], 90.00th=[ 122], 95.00th=[ 125], 00:19:24.955 | 99.00th=[ 133], 99.50th=[ 135], 99.90th=[ 141], 99.95th=[ 143], 00:19:24.955 | 99.99th=[ 145] 00:19:24.955 write: IOPS=4630, BW=18.1MiB/s (19.0MB/s)(18.1MiB/1001msec); 0 zone resets 00:19:24.955 slat (nsec): min=10394, max=48896, avg=11391.43, stdev=1333.33 00:19:24.955 clat (usec): min=67, max=140, avg=92.39, stdev=14.07 00:19:24.955 lat (usec): min=81, max=151, avg=103.79, stdev=14.15 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 75], 5.00th=[ 77], 10.00th=[ 79], 20.00th=[ 81], 00:19:24.955 | 30.00th=[ 83], 40.00th=[ 85], 50.00th=[ 87], 60.00th=[ 92], 00:19:24.955 | 70.00th=[ 100], 80.00th=[ 109], 90.00th=[ 115], 95.00th=[ 119], 00:19:24.955 | 99.00th=[ 126], 99.50th=[ 130], 99.90th=[ 135], 99.95th=[ 137], 00:19:24.955 | 99.99th=[ 141] 00:19:24.955 bw ( KiB/s): min=20480, max=20480, per=28.91%, avg=20480.00, stdev= 0.00, samples=1 00:19:24.955 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:24.955 lat (usec) : 100=63.83%, 250=36.17% 00:19:24.955 cpu : usr=5.50%, sys=10.10%, ctx=9244, majf=0, minf=1 00:19:24.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 issued rwts: total=4608,4635,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.955 job1: (groupid=0, jobs=1): err= 0: pid=662730: Wed Apr 24 15:20:28 2024 00:19:24.955 read: IOPS=3616, BW=14.1MiB/s (14.8MB/s)(14.1MiB/1001msec) 00:19:24.955 slat (nsec): min=8557, max=31640, avg=9373.57, stdev=1066.32 00:19:24.955 clat (usec): min=85, max=193, avg=119.59, stdev=10.17 00:19:24.955 lat (usec): min=94, max=203, avg=128.96, stdev=10.20 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 98], 5.00th=[ 103], 10.00th=[ 108], 20.00th=[ 112], 00:19:24.955 | 30.00th=[ 115], 40.00th=[ 118], 50.00th=[ 120], 60.00th=[ 123], 00:19:24.955 | 70.00th=[ 125], 80.00th=[ 129], 90.00th=[ 133], 95.00th=[ 137], 00:19:24.955 | 99.00th=[ 145], 99.50th=[ 149], 99.90th=[ 163], 99.95th=[ 172], 00:19:24.955 | 99.99th=[ 194] 00:19:24.955 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:24.955 slat (nsec): min=10593, max=42916, avg=11511.67, stdev=1063.65 00:19:24.955 clat (usec): min=78, max=184, avg=114.78, stdev=10.42 00:19:24.955 lat (usec): min=90, max=195, avg=126.30, stdev=10.54 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 92], 5.00th=[ 98], 10.00th=[ 102], 20.00th=[ 106], 00:19:24.955 | 30.00th=[ 110], 40.00th=[ 113], 50.00th=[ 115], 60.00th=[ 118], 00:19:24.955 | 70.00th=[ 121], 80.00th=[ 124], 90.00th=[ 129], 95.00th=[ 133], 00:19:24.955 | 99.00th=[ 141], 99.50th=[ 143], 99.90th=[ 153], 99.95th=[ 157], 00:19:24.955 | 99.99th=[ 184] 00:19:24.955 bw ( KiB/s): min=16384, max=16384, per=23.13%, avg=16384.00, stdev= 0.00, samples=1 00:19:24.955 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:24.955 lat (usec) : 100=4.95%, 250=95.05% 00:19:24.955 cpu : usr=5.30%, sys=8.00%, ctx=7717, majf=0, minf=1 00:19:24.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 issued rwts: total=3620,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.955 job2: (groupid=0, jobs=1): err= 0: pid=662731: Wed Apr 24 15:20:28 2024 00:19:24.955 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:24.955 slat (nsec): min=8603, max=20418, avg=9387.60, stdev=850.05 00:19:24.955 clat (usec): min=81, max=141, avg=95.94, stdev= 6.42 00:19:24.955 lat (usec): min=91, max=151, avg=105.33, stdev= 6.48 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 85], 5.00th=[ 88], 10.00th=[ 89], 20.00th=[ 91], 00:19:24.955 | 30.00th=[ 93], 40.00th=[ 94], 50.00th=[ 95], 60.00th=[ 97], 00:19:24.955 | 70.00th=[ 99], 80.00th=[ 101], 90.00th=[ 104], 95.00th=[ 109], 00:19:24.955 | 99.00th=[ 116], 99.50th=[ 119], 99.90th=[ 127], 99.95th=[ 128], 00:19:24.955 | 99.99th=[ 143] 00:19:24.955 write: IOPS=4754, BW=18.6MiB/s (19.5MB/s)(18.6MiB/1001msec); 0 zone resets 00:19:24.955 slat (nsec): min=10736, max=43382, avg=11625.69, stdev=1172.73 00:19:24.955 clat (usec): min=74, max=140, avg=92.44, stdev= 6.54 00:19:24.955 lat (usec): min=87, max=163, avg=104.06, stdev= 6.69 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 82], 5.00th=[ 84], 10.00th=[ 86], 20.00th=[ 88], 00:19:24.955 | 30.00th=[ 89], 40.00th=[ 90], 50.00th=[ 92], 60.00th=[ 93], 00:19:24.955 | 70.00th=[ 95], 80.00th=[ 97], 90.00th=[ 101], 95.00th=[ 105], 00:19:24.955 | 99.00th=[ 115], 99.50th=[ 118], 99.90th=[ 125], 99.95th=[ 133], 00:19:24.955 | 99.99th=[ 141] 00:19:24.955 bw ( KiB/s): min=20480, max=20480, per=28.91%, avg=20480.00, stdev= 0.00, samples=1 00:19:24.955 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:24.955 lat (usec) : 100=83.36%, 250=16.64% 00:19:24.955 cpu : usr=6.20%, sys=9.80%, ctx=9367, majf=0, minf=1 00:19:24.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 issued rwts: total=4608,4759,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.955 job3: (groupid=0, jobs=1): err= 0: pid=662732: Wed Apr 24 15:20:28 2024 00:19:24.955 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:24.955 slat (nsec): min=8828, max=39316, avg=9675.54, stdev=1034.22 00:19:24.955 clat (usec): min=80, max=176, avg=109.08, stdev=16.05 00:19:24.955 lat (usec): min=89, max=185, avg=118.75, stdev=16.11 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 85], 5.00th=[ 88], 10.00th=[ 90], 20.00th=[ 93], 00:19:24.955 | 30.00th=[ 96], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 117], 00:19:24.955 | 70.00th=[ 122], 80.00th=[ 126], 90.00th=[ 131], 95.00th=[ 135], 00:19:24.955 | 99.00th=[ 143], 99.50th=[ 147], 99.90th=[ 153], 99.95th=[ 163], 00:19:24.955 | 99.99th=[ 178] 00:19:24.955 write: IOPS=4233, BW=16.5MiB/s (17.3MB/s)(16.6MiB/1001msec); 0 zone resets 00:19:24.955 slat (nsec): min=10757, max=46163, avg=11765.76, stdev=1249.67 00:19:24.955 clat (usec): min=67, max=160, avg=105.28, stdev=14.66 00:19:24.955 lat (usec): min=89, max=200, avg=117.04, stdev=14.78 00:19:24.955 clat percentiles (usec): 00:19:24.955 | 1.00th=[ 83], 5.00th=[ 86], 10.00th=[ 88], 20.00th=[ 91], 00:19:24.955 | 30.00th=[ 93], 40.00th=[ 97], 50.00th=[ 105], 60.00th=[ 113], 00:19:24.955 | 70.00th=[ 117], 80.00th=[ 121], 90.00th=[ 125], 95.00th=[ 129], 00:19:24.955 | 99.00th=[ 135], 99.50th=[ 139], 99.90th=[ 149], 99.95th=[ 155], 00:19:24.955 | 99.99th=[ 161] 00:19:24.955 bw ( KiB/s): min=16384, max=16384, per=23.13%, avg=16384.00, stdev= 0.00, samples=1 00:19:24.955 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:24.955 lat (usec) : 100=42.44%, 250=57.56% 00:19:24.955 cpu : usr=4.60%, sys=9.80%, ctx=8334, majf=0, minf=1 00:19:24.955 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.955 issued rwts: total=4096,4238,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.955 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.955 00:19:24.955 Run status group 0 (all jobs): 00:19:24.955 READ: bw=66.1MiB/s (69.3MB/s), 14.1MiB/s-18.0MiB/s (14.8MB/s-18.9MB/s), io=66.1MiB (69.4MB), run=1001-1001msec 00:19:24.956 WRITE: bw=69.2MiB/s (72.5MB/s), 16.0MiB/s-18.6MiB/s (16.8MB/s-19.5MB/s), io=69.2MiB (72.6MB), run=1001-1001msec 00:19:24.956 00:19:24.956 Disk stats (read/write): 00:19:24.956 nvme0n1: ios=3662/4096, merge=0/0, ticks=342/358, in_queue=700, util=85.77% 00:19:24.956 nvme0n2: ios=3072/3527, merge=0/0, ticks=339/375, in_queue=714, util=86.65% 00:19:24.956 nvme0n3: ios=3869/4096, merge=0/0, ticks=340/352, in_queue=692, util=88.91% 00:19:24.956 nvme0n4: ios=3584/3634, merge=0/0, ticks=365/359, in_queue=724, util=89.66% 00:19:24.956 15:20:28 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:24.956 [global] 00:19:24.956 thread=1 00:19:24.956 invalidate=1 00:19:24.956 rw=write 00:19:24.956 time_based=1 00:19:24.956 runtime=1 00:19:24.956 ioengine=libaio 00:19:24.956 direct=1 00:19:24.956 bs=4096 00:19:24.956 iodepth=128 00:19:24.956 norandommap=0 00:19:24.956 numjobs=1 00:19:24.956 00:19:24.956 verify_dump=1 00:19:24.956 verify_backlog=512 00:19:24.956 verify_state_save=0 00:19:24.956 do_verify=1 00:19:24.956 verify=crc32c-intel 00:19:24.956 [job0] 00:19:24.956 filename=/dev/nvme0n1 00:19:24.956 [job1] 00:19:24.956 filename=/dev/nvme0n2 00:19:24.956 [job2] 00:19:24.956 filename=/dev/nvme0n3 00:19:24.956 [job3] 00:19:24.956 filename=/dev/nvme0n4 00:19:24.956 Could not set queue depth (nvme0n1) 00:19:24.956 Could not set queue depth (nvme0n2) 00:19:24.956 Could not set queue depth (nvme0n3) 00:19:24.956 Could not set queue depth (nvme0n4) 00:19:25.213 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:25.213 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:25.213 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:25.213 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:25.213 fio-3.35 00:19:25.213 Starting 4 threads 00:19:26.584 00:19:26.584 job0: (groupid=0, jobs=1): err= 0: pid=663029: Wed Apr 24 15:20:30 2024 00:19:26.584 read: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec) 00:19:26.584 slat (usec): min=2, max=5465, avg=66.89, stdev=331.26 00:19:26.584 clat (usec): min=2509, max=17769, avg=8707.58, stdev=2945.82 00:19:26.584 lat (usec): min=2625, max=17772, avg=8774.47, stdev=2959.50 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 3687], 5.00th=[ 4490], 10.00th=[ 5080], 20.00th=[ 5997], 00:19:26.584 | 30.00th=[ 6783], 40.00th=[ 7570], 50.00th=[ 8455], 60.00th=[ 9241], 00:19:26.584 | 70.00th=[10028], 80.00th=[11338], 90.00th=[12911], 95.00th=[14091], 00:19:26.584 | 99.00th=[15926], 99.50th=[17171], 99.90th=[17695], 99.95th=[17695], 00:19:26.584 | 99.99th=[17695] 00:19:26.584 write: IOPS=7361, BW=28.8MiB/s (30.2MB/s)(28.8MiB/1003msec); 0 zone resets 00:19:26.584 slat (usec): min=2, max=5354, avg=66.88, stdev=324.44 00:19:26.584 clat (usec): min=2291, max=21800, avg=8734.14, stdev=3572.63 00:19:26.584 lat (usec): min=2310, max=21806, avg=8801.02, stdev=3590.69 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 3523], 5.00th=[ 4359], 10.00th=[ 4752], 20.00th=[ 5735], 00:19:26.584 | 30.00th=[ 6456], 40.00th=[ 6915], 50.00th=[ 7832], 60.00th=[ 8979], 00:19:26.584 | 70.00th=[10028], 80.00th=[11469], 90.00th=[13960], 95.00th=[15926], 00:19:26.584 | 99.00th=[19792], 99.50th=[20055], 99.90th=[21103], 99.95th=[21365], 00:19:26.584 | 99.99th=[21890] 00:19:26.584 bw ( KiB/s): min=26248, max=31808, per=27.02%, avg=29028.00, stdev=3931.51, samples=2 00:19:26.584 iops : min= 6562, max= 7952, avg=7257.00, stdev=982.88, samples=2 00:19:26.584 lat (msec) : 4=2.34%, 10=67.75%, 20=29.74%, 50=0.16% 00:19:26.584 cpu : usr=3.49%, sys=5.89%, ctx=1239, majf=0, minf=1 00:19:26.584 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:26.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:26.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:26.584 issued rwts: total=7168,7384,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:26.584 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:26.584 job1: (groupid=0, jobs=1): err= 0: pid=663030: Wed Apr 24 15:20:30 2024 00:19:26.584 read: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec) 00:19:26.584 slat (usec): min=2, max=6026, avg=68.56, stdev=325.17 00:19:26.584 clat (usec): min=2630, max=19408, avg=9117.20, stdev=2913.52 00:19:26.584 lat (usec): min=2634, max=21191, avg=9185.76, stdev=2927.87 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 4178], 5.00th=[ 5211], 10.00th=[ 5997], 20.00th=[ 6783], 00:19:26.584 | 30.00th=[ 7308], 40.00th=[ 7635], 50.00th=[ 8291], 60.00th=[ 9372], 00:19:26.584 | 70.00th=[10552], 80.00th=[11600], 90.00th=[13173], 95.00th=[14615], 00:19:26.584 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19530], 99.95th=[19530], 00:19:26.584 | 99.99th=[19530] 00:19:26.584 write: IOPS=7249, BW=28.3MiB/s (29.7MB/s)(28.4MiB/1003msec); 0 zone resets 00:19:26.584 slat (usec): min=2, max=7609, avg=66.31, stdev=325.49 00:19:26.584 clat (usec): min=2227, max=22831, avg=8497.59, stdev=3329.81 00:19:26.584 lat (usec): min=2592, max=22834, avg=8563.89, stdev=3347.09 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 3294], 5.00th=[ 4293], 10.00th=[ 4948], 20.00th=[ 5735], 00:19:26.584 | 30.00th=[ 6456], 40.00th=[ 6915], 50.00th=[ 7635], 60.00th=[ 8586], 00:19:26.584 | 70.00th=[ 9765], 80.00th=[11338], 90.00th=[13042], 95.00th=[15270], 00:19:26.584 | 99.00th=[17957], 99.50th=[18220], 99.90th=[18744], 99.95th=[19530], 00:19:26.584 | 99.99th=[22938] 00:19:26.584 bw ( KiB/s): min=28672, max=28720, per=26.71%, avg=28696.00, stdev=33.94, samples=2 00:19:26.584 iops : min= 7168, max= 7180, avg=7174.00, stdev= 8.49, samples=2 00:19:26.584 lat (msec) : 4=1.67%, 10=66.87%, 20=31.44%, 50=0.02% 00:19:26.584 cpu : usr=4.29%, sys=4.99%, ctx=1414, majf=0, minf=1 00:19:26.584 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:26.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:26.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:26.584 issued rwts: total=7168,7271,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:26.584 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:26.584 job2: (groupid=0, jobs=1): err= 0: pid=663033: Wed Apr 24 15:20:30 2024 00:19:26.584 read: IOPS=5919, BW=23.1MiB/s (24.2MB/s)(23.2MiB/1002msec) 00:19:26.584 slat (usec): min=2, max=6111, avg=81.25, stdev=356.80 00:19:26.584 clat (usec): min=486, max=28817, avg=10550.00, stdev=3630.92 00:19:26.584 lat (usec): min=1429, max=29356, avg=10631.25, stdev=3642.55 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 3982], 5.00th=[ 6259], 10.00th=[ 6980], 20.00th=[ 7701], 00:19:26.584 | 30.00th=[ 8455], 40.00th=[ 8979], 50.00th=[ 9765], 60.00th=[10814], 00:19:26.584 | 70.00th=[11994], 80.00th=[13042], 90.00th=[15008], 95.00th=[16712], 00:19:26.584 | 99.00th=[23987], 99.50th=[25035], 99.90th=[28181], 99.95th=[28705], 00:19:26.584 | 99.99th=[28705] 00:19:26.584 write: IOPS=6131, BW=24.0MiB/s (25.1MB/s)(24.0MiB/1002msec); 0 zone resets 00:19:26.584 slat (usec): min=2, max=4813, avg=80.83, stdev=355.91 00:19:26.584 clat (usec): min=3523, max=28764, avg=10412.44, stdev=4148.24 00:19:26.584 lat (usec): min=3854, max=28767, avg=10493.27, stdev=4178.45 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 4752], 5.00th=[ 6128], 10.00th=[ 6521], 20.00th=[ 7242], 00:19:26.584 | 30.00th=[ 7701], 40.00th=[ 8356], 50.00th=[ 9372], 60.00th=[10421], 00:19:26.584 | 70.00th=[11207], 80.00th=[12780], 90.00th=[16188], 95.00th=[20055], 00:19:26.584 | 99.00th=[23200], 99.50th=[26346], 99.90th=[28705], 99.95th=[28705], 00:19:26.584 | 99.99th=[28705] 00:19:26.584 bw ( KiB/s): min=24576, max=24576, per=22.87%, avg=24576.00, stdev= 0.00, samples=2 00:19:26.584 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:19:26.584 lat (usec) : 500=0.01% 00:19:26.584 lat (msec) : 2=0.12%, 4=0.65%, 10=52.78%, 20=42.67%, 50=3.78% 00:19:26.584 cpu : usr=2.50%, sys=5.09%, ctx=1072, majf=0, minf=1 00:19:26.584 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:26.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:26.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:26.584 issued rwts: total=5931,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:26.584 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:26.584 job3: (groupid=0, jobs=1): err= 0: pid=663034: Wed Apr 24 15:20:30 2024 00:19:26.584 read: IOPS=5925, BW=23.1MiB/s (24.3MB/s)(23.2MiB/1003msec) 00:19:26.584 slat (usec): min=2, max=5464, avg=81.88, stdev=396.80 00:19:26.584 clat (usec): min=2096, max=22526, avg=10508.75, stdev=3570.18 00:19:26.584 lat (usec): min=2809, max=22531, avg=10590.62, stdev=3584.73 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 3458], 5.00th=[ 5407], 10.00th=[ 6390], 20.00th=[ 7308], 00:19:26.584 | 30.00th=[ 8455], 40.00th=[ 9241], 50.00th=[ 9896], 60.00th=[11207], 00:19:26.584 | 70.00th=[12256], 80.00th=[13435], 90.00th=[15401], 95.00th=[16909], 00:19:26.584 | 99.00th=[19792], 99.50th=[22152], 99.90th=[22152], 99.95th=[22414], 00:19:26.584 | 99.99th=[22414] 00:19:26.584 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:26.584 slat (usec): min=2, max=5161, avg=80.09, stdev=364.46 00:19:26.584 clat (usec): min=3302, max=21134, avg=10478.24, stdev=3419.07 00:19:26.584 lat (usec): min=3386, max=22306, avg=10558.34, stdev=3437.86 00:19:26.584 clat percentiles (usec): 00:19:26.584 | 1.00th=[ 4293], 5.00th=[ 5407], 10.00th=[ 6194], 20.00th=[ 7701], 00:19:26.584 | 30.00th=[ 8455], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10814], 00:19:26.584 | 70.00th=[11731], 80.00th=[13173], 90.00th=[14877], 95.00th=[17171], 00:19:26.584 | 99.00th=[19792], 99.50th=[20579], 99.90th=[21103], 99.95th=[21103], 00:19:26.584 | 99.99th=[21103] 00:19:26.584 bw ( KiB/s): min=24208, max=24944, per=22.87%, avg=24576.00, stdev=520.43, samples=2 00:19:26.584 iops : min= 6052, max= 6236, avg=6144.00, stdev=130.11, samples=2 00:19:26.584 lat (msec) : 4=0.88%, 10=48.12%, 20=50.22%, 50=0.79% 00:19:26.584 cpu : usr=2.59%, sys=5.09%, ctx=1221, majf=0, minf=1 00:19:26.584 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:26.584 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:26.584 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:26.584 issued rwts: total=5943,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:26.584 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:26.584 00:19:26.584 Run status group 0 (all jobs): 00:19:26.584 READ: bw=102MiB/s (107MB/s), 23.1MiB/s-27.9MiB/s (24.2MB/s-29.3MB/s), io=102MiB (107MB), run=1002-1003msec 00:19:26.584 WRITE: bw=105MiB/s (110MB/s), 23.9MiB/s-28.8MiB/s (25.1MB/s-30.2MB/s), io=105MiB (110MB), run=1002-1003msec 00:19:26.584 00:19:26.584 Disk stats (read/write): 00:19:26.584 nvme0n1: ios=5682/5752, merge=0/0, ticks=17093/17257, in_queue=34350, util=84.17% 00:19:26.584 nvme0n2: ios=5888/6144, merge=0/0, ticks=17022/17016, in_queue=34038, util=85.55% 00:19:26.584 nvme0n3: ios=5120/5233, merge=0/0, ticks=15112/15600, in_queue=30712, util=87.70% 00:19:26.584 nvme0n4: ios=5120/5351, merge=0/0, ticks=17686/17183, in_queue=34869, util=88.97% 00:19:26.584 15:20:30 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:26.584 [global] 00:19:26.584 thread=1 00:19:26.584 invalidate=1 00:19:26.584 rw=randwrite 00:19:26.584 time_based=1 00:19:26.584 runtime=1 00:19:26.584 ioengine=libaio 00:19:26.584 direct=1 00:19:26.584 bs=4096 00:19:26.584 iodepth=128 00:19:26.584 norandommap=0 00:19:26.584 numjobs=1 00:19:26.584 00:19:26.584 verify_dump=1 00:19:26.584 verify_backlog=512 00:19:26.584 verify_state_save=0 00:19:26.584 do_verify=1 00:19:26.584 verify=crc32c-intel 00:19:26.584 [job0] 00:19:26.584 filename=/dev/nvme0n1 00:19:26.584 [job1] 00:19:26.584 filename=/dev/nvme0n2 00:19:26.584 [job2] 00:19:26.584 filename=/dev/nvme0n3 00:19:26.584 [job3] 00:19:26.584 filename=/dev/nvme0n4 00:19:26.584 Could not set queue depth (nvme0n1) 00:19:26.584 Could not set queue depth (nvme0n2) 00:19:26.584 Could not set queue depth (nvme0n3) 00:19:26.584 Could not set queue depth (nvme0n4) 00:19:26.841 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:26.841 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:26.841 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:26.841 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:26.841 fio-3.35 00:19:26.841 Starting 4 threads 00:19:28.215 00:19:28.215 job0: (groupid=0, jobs=1): err= 0: pid=663322: Wed Apr 24 15:20:31 2024 00:19:28.215 read: IOPS=7348, BW=28.7MiB/s (30.1MB/s)(28.8MiB/1002msec) 00:19:28.215 slat (usec): min=2, max=5474, avg=72.32, stdev=327.91 00:19:28.215 clat (usec): min=758, max=20085, avg=9252.02, stdev=4143.44 00:19:28.215 lat (usec): min=1164, max=20090, avg=9324.34, stdev=4166.57 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 3228], 5.00th=[ 4752], 10.00th=[ 5080], 20.00th=[ 5669], 00:19:28.215 | 30.00th=[ 6128], 40.00th=[ 6783], 50.00th=[ 7832], 60.00th=[ 9372], 00:19:28.215 | 70.00th=[11207], 80.00th=[13173], 90.00th=[15795], 95.00th=[17695], 00:19:28.215 | 99.00th=[19006], 99.50th=[19530], 99.90th=[19792], 99.95th=[19792], 00:19:28.215 | 99.99th=[20055] 00:19:28.215 write: IOPS=7664, BW=29.9MiB/s (31.4MB/s)(30.0MiB/1002msec); 0 zone resets 00:19:28.215 slat (usec): min=2, max=4196, avg=56.87, stdev=256.26 00:19:28.215 clat (usec): min=2877, max=18133, avg=7641.09, stdev=2694.77 00:19:28.215 lat (usec): min=2913, max=19263, avg=7697.96, stdev=2706.64 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 3720], 5.00th=[ 4293], 10.00th=[ 4686], 20.00th=[ 5211], 00:19:28.215 | 30.00th=[ 5800], 40.00th=[ 6259], 50.00th=[ 7111], 60.00th=[ 7832], 00:19:28.215 | 70.00th=[ 8848], 80.00th=[10028], 90.00th=[11469], 95.00th=[12256], 00:19:28.215 | 99.00th=[15401], 99.50th=[16188], 99.90th=[18220], 99.95th=[18220], 00:19:28.215 | 99.99th=[18220] 00:19:28.215 bw ( KiB/s): min=27664, max=33776, per=27.50%, avg=30720.00, stdev=4321.84, samples=2 00:19:28.215 iops : min= 6916, max= 8444, avg=7680.00, stdev=1080.46, samples=2 00:19:28.215 lat (usec) : 1000=0.01% 00:19:28.215 lat (msec) : 2=0.21%, 4=2.22%, 10=69.69%, 20=27.87%, 50=0.01% 00:19:28.215 cpu : usr=3.80%, sys=6.79%, ctx=1470, majf=0, minf=1 00:19:28.215 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:28.215 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.215 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:28.215 issued rwts: total=7363,7680,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.215 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:28.215 job1: (groupid=0, jobs=1): err= 0: pid=663323: Wed Apr 24 15:20:31 2024 00:19:28.215 read: IOPS=6579, BW=25.7MiB/s (26.9MB/s)(25.7MiB/1001msec) 00:19:28.215 slat (usec): min=2, max=6663, avg=75.30, stdev=383.19 00:19:28.215 clat (usec): min=632, max=21382, avg=9597.60, stdev=3322.69 00:19:28.215 lat (usec): min=634, max=21386, avg=9672.90, stdev=3341.18 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 3916], 5.00th=[ 4686], 10.00th=[ 5342], 20.00th=[ 6718], 00:19:28.215 | 30.00th=[ 7767], 40.00th=[ 8586], 50.00th=[ 9372], 60.00th=[10028], 00:19:28.215 | 70.00th=[11076], 80.00th=[12387], 90.00th=[14091], 95.00th=[15270], 00:19:28.215 | 99.00th=[19268], 99.50th=[20579], 99.90th=[21365], 99.95th=[21365], 00:19:28.215 | 99.99th=[21365] 00:19:28.215 write: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec); 0 zone resets 00:19:28.215 slat (usec): min=2, max=4757, avg=71.63, stdev=351.31 00:19:28.215 clat (usec): min=2797, max=20609, avg=9550.36, stdev=3706.66 00:19:28.215 lat (usec): min=2823, max=20614, avg=9621.99, stdev=3725.88 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 3982], 5.00th=[ 4621], 10.00th=[ 5342], 20.00th=[ 6128], 00:19:28.215 | 30.00th=[ 7046], 40.00th=[ 8029], 50.00th=[ 8848], 60.00th=[10028], 00:19:28.215 | 70.00th=[11207], 80.00th=[12518], 90.00th=[15008], 95.00th=[16450], 00:19:28.215 | 99.00th=[19792], 99.50th=[20317], 99.90th=[20579], 99.95th=[20579], 00:19:28.215 | 99.99th=[20579] 00:19:28.215 bw ( KiB/s): min=29856, max=29856, per=26.73%, avg=29856.00, stdev= 0.00, samples=1 00:19:28.215 iops : min= 7466, max= 7466, avg=7466.00, stdev= 0.00, samples=1 00:19:28.215 lat (usec) : 750=0.10% 00:19:28.215 lat (msec) : 4=1.34%, 10=58.56%, 20=39.27%, 50=0.74% 00:19:28.215 cpu : usr=3.60%, sys=5.70%, ctx=1375, majf=0, minf=1 00:19:28.215 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:28.215 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.215 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:28.215 issued rwts: total=6586,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.215 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:28.215 job2: (groupid=0, jobs=1): err= 0: pid=663324: Wed Apr 24 15:20:31 2024 00:19:28.215 read: IOPS=6662, BW=26.0MiB/s (27.3MB/s)(26.1MiB/1003msec) 00:19:28.215 slat (usec): min=2, max=4453, avg=70.50, stdev=332.32 00:19:28.215 clat (usec): min=204, max=17001, avg=9215.44, stdev=2360.05 00:19:28.215 lat (usec): min=3289, max=20908, avg=9285.94, stdev=2362.65 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 4424], 5.00th=[ 5800], 10.00th=[ 6390], 20.00th=[ 7242], 00:19:28.215 | 30.00th=[ 7701], 40.00th=[ 8455], 50.00th=[ 8979], 60.00th=[ 9634], 00:19:28.215 | 70.00th=[10290], 80.00th=[11207], 90.00th=[12256], 95.00th=[13304], 00:19:28.215 | 99.00th=[15270], 99.50th=[16909], 99.90th=[16909], 99.95th=[16909], 00:19:28.215 | 99.99th=[16909] 00:19:28.215 write: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec); 0 zone resets 00:19:28.215 slat (usec): min=2, max=4947, avg=70.33, stdev=333.94 00:19:28.215 clat (usec): min=2973, max=16557, avg=9115.04, stdev=2736.98 00:19:28.215 lat (usec): min=2976, max=16560, avg=9185.37, stdev=2741.76 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 4359], 5.00th=[ 5211], 10.00th=[ 5800], 20.00th=[ 6587], 00:19:28.215 | 30.00th=[ 7308], 40.00th=[ 7963], 50.00th=[ 8717], 60.00th=[ 9765], 00:19:28.215 | 70.00th=[10683], 80.00th=[11863], 90.00th=[12911], 95.00th=[13566], 00:19:28.215 | 99.00th=[15401], 99.50th=[16188], 99.90th=[16581], 99.95th=[16581], 00:19:28.215 | 99.99th=[16581] 00:19:28.215 bw ( KiB/s): min=27992, max=28536, per=25.31%, avg=28264.00, stdev=384.67, samples=2 00:19:28.215 iops : min= 6998, max= 7134, avg=7066.00, stdev=96.17, samples=2 00:19:28.215 lat (usec) : 250=0.01% 00:19:28.215 lat (msec) : 4=0.56%, 10=63.75%, 20=35.69% 00:19:28.215 cpu : usr=3.49%, sys=5.89%, ctx=1363, majf=0, minf=1 00:19:28.215 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:28.215 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.215 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:28.215 issued rwts: total=6682,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.215 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:28.215 job3: (groupid=0, jobs=1): err= 0: pid=663325: Wed Apr 24 15:20:31 2024 00:19:28.215 read: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec) 00:19:28.215 slat (usec): min=2, max=4257, avg=78.15, stdev=359.70 00:19:28.215 clat (usec): min=3424, max=22399, avg=10501.68, stdev=3248.75 00:19:28.215 lat (usec): min=3501, max=22403, avg=10579.82, stdev=3262.54 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 4948], 5.00th=[ 6063], 10.00th=[ 6849], 20.00th=[ 7767], 00:19:28.215 | 30.00th=[ 8586], 40.00th=[ 9241], 50.00th=[10028], 60.00th=[10814], 00:19:28.215 | 70.00th=[11863], 80.00th=[13173], 90.00th=[15008], 95.00th=[16712], 00:19:28.215 | 99.00th=[20579], 99.50th=[21103], 99.90th=[22152], 99.95th=[22152], 00:19:28.215 | 99.99th=[22414] 00:19:28.215 write: IOPS=6483, BW=25.3MiB/s (26.6MB/s)(25.4MiB/1003msec); 0 zone resets 00:19:28.215 slat (usec): min=2, max=5372, avg=76.20, stdev=357.37 00:19:28.215 clat (usec): min=1545, max=19138, avg=9574.91, stdev=2754.82 00:19:28.215 lat (usec): min=3260, max=19345, avg=9651.11, stdev=2765.72 00:19:28.215 clat percentiles (usec): 00:19:28.215 | 1.00th=[ 4424], 5.00th=[ 5473], 10.00th=[ 6194], 20.00th=[ 7308], 00:19:28.215 | 30.00th=[ 7963], 40.00th=[ 8586], 50.00th=[ 9110], 60.00th=[10028], 00:19:28.215 | 70.00th=[10814], 80.00th=[11863], 90.00th=[13566], 95.00th=[14484], 00:19:28.215 | 99.00th=[16319], 99.50th=[17433], 99.90th=[18744], 99.95th=[18744], 00:19:28.215 | 99.99th=[19268] 00:19:28.215 bw ( KiB/s): min=22568, max=28440, per=22.83%, avg=25504.00, stdev=4152.13, samples=2 00:19:28.215 iops : min= 5642, max= 7110, avg=6376.00, stdev=1038.03, samples=2 00:19:28.215 lat (msec) : 2=0.01%, 4=0.15%, 10=55.34%, 20=43.90%, 50=0.60% 00:19:28.215 cpu : usr=2.69%, sys=5.89%, ctx=1218, majf=0, minf=1 00:19:28.215 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:28.215 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:28.215 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:28.215 issued rwts: total=6144,6503,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:28.215 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:28.215 00:19:28.215 Run status group 0 (all jobs): 00:19:28.215 READ: bw=104MiB/s (109MB/s), 23.9MiB/s-28.7MiB/s (25.1MB/s-30.1MB/s), io=105MiB (110MB), run=1001-1003msec 00:19:28.215 WRITE: bw=109MiB/s (114MB/s), 25.3MiB/s-29.9MiB/s (26.6MB/s-31.4MB/s), io=109MiB (115MB), run=1001-1003msec 00:19:28.215 00:19:28.215 Disk stats (read/write): 00:19:28.215 nvme0n1: ios=5682/5905, merge=0/0, ticks=17557/15844, in_queue=33401, util=85.17% 00:19:28.215 nvme0n2: ios=5632/5923, merge=0/0, ticks=16445/16821, in_queue=33266, util=85.95% 00:19:28.215 nvme0n3: ios=5841/6144, merge=0/0, ticks=17139/17564, in_queue=34703, util=86.52% 00:19:28.216 nvme0n4: ios=5472/5632, merge=0/0, ticks=17285/17147, in_queue=34432, util=88.72% 00:19:28.216 15:20:31 -- target/fio.sh@55 -- # sync 00:19:28.216 15:20:31 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:28.216 15:20:31 -- target/fio.sh@59 -- # fio_pid=663501 00:19:28.216 15:20:31 -- target/fio.sh@61 -- # sleep 3 00:19:28.216 [global] 00:19:28.216 thread=1 00:19:28.216 invalidate=1 00:19:28.216 rw=read 00:19:28.216 time_based=1 00:19:28.216 runtime=10 00:19:28.216 ioengine=libaio 00:19:28.216 direct=1 00:19:28.216 bs=4096 00:19:28.216 iodepth=1 00:19:28.216 norandommap=1 00:19:28.216 numjobs=1 00:19:28.216 00:19:28.216 [job0] 00:19:28.216 filename=/dev/nvme0n1 00:19:28.216 [job1] 00:19:28.216 filename=/dev/nvme0n2 00:19:28.216 [job2] 00:19:28.216 filename=/dev/nvme0n3 00:19:28.216 [job3] 00:19:28.216 filename=/dev/nvme0n4 00:19:28.216 Could not set queue depth (nvme0n1) 00:19:28.216 Could not set queue depth (nvme0n2) 00:19:28.216 Could not set queue depth (nvme0n3) 00:19:28.216 Could not set queue depth (nvme0n4) 00:19:28.216 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.216 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.216 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.216 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:28.216 fio-3.35 00:19:28.216 Starting 4 threads 00:19:31.493 15:20:34 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:31.494 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=82698240, buflen=4096 00:19:31.494 fio: pid=663627, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:31.494 15:20:34 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:31.494 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=103034880, buflen=4096 00:19:31.494 fio: pid=663626, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:31.494 15:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:31.494 15:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:31.494 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=62025728, buflen=4096 00:19:31.494 fio: pid=663623, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:31.751 15:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:31.752 15:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:31.752 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=55209984, buflen=4096 00:19:31.752 fio: pid=663624, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:31.752 15:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:31.752 15:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:31.752 00:19:31.752 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=663623: Wed Apr 24 15:20:35 2024 00:19:31.752 read: IOPS=10.1k, BW=39.5MiB/s (41.4MB/s)(123MiB/3116msec) 00:19:31.752 slat (usec): min=5, max=11867, avg=10.45, stdev=95.03 00:19:31.752 clat (usec): min=59, max=194, avg=86.93, stdev= 6.50 00:19:31.752 lat (usec): min=68, max=12012, avg=97.38, stdev=95.71 00:19:31.752 clat percentiles (usec): 00:19:31.752 | 1.00th=[ 74], 5.00th=[ 79], 10.00th=[ 81], 20.00th=[ 83], 00:19:31.752 | 30.00th=[ 84], 40.00th=[ 85], 50.00th=[ 87], 60.00th=[ 88], 00:19:31.752 | 70.00th=[ 90], 80.00th=[ 92], 90.00th=[ 95], 95.00th=[ 98], 00:19:31.752 | 99.00th=[ 106], 99.50th=[ 111], 99.90th=[ 121], 99.95th=[ 127], 00:19:31.752 | 99.99th=[ 153] 00:19:31.752 bw ( KiB/s): min=40120, max=41288, per=31.66%, avg=40654.67, stdev=473.68, samples=6 00:19:31.752 iops : min=10030, max=10322, avg=10163.67, stdev=118.42, samples=6 00:19:31.752 lat (usec) : 100=96.72%, 250=3.28% 00:19:31.752 cpu : usr=3.92%, sys=11.36%, ctx=31532, majf=0, minf=1 00:19:31.752 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 issued rwts: total=31528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.752 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:31.752 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=663624: Wed Apr 24 15:20:35 2024 00:19:31.752 read: IOPS=8981, BW=35.1MiB/s (36.8MB/s)(117MiB/3325msec) 00:19:31.752 slat (usec): min=7, max=12910, avg=11.43, stdev=149.10 00:19:31.752 clat (usec): min=53, max=942, avg=98.46, stdev=23.02 00:19:31.752 lat (usec): min=67, max=13006, avg=109.89, stdev=150.80 00:19:31.752 clat percentiles (usec): 00:19:31.752 | 1.00th=[ 63], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 82], 00:19:31.752 | 30.00th=[ 85], 40.00th=[ 87], 50.00th=[ 90], 60.00th=[ 94], 00:19:31.752 | 70.00th=[ 114], 80.00th=[ 126], 90.00th=[ 133], 95.00th=[ 139], 00:19:31.752 | 99.00th=[ 147], 99.50th=[ 151], 99.90th=[ 163], 99.95th=[ 178], 00:19:31.752 | 99.99th=[ 192] 00:19:31.752 bw ( KiB/s): min=29032, max=40648, per=27.43%, avg=35224.33, stdev=4939.02, samples=6 00:19:31.752 iops : min= 7258, max=10162, avg=8806.00, stdev=1234.73, samples=6 00:19:31.752 lat (usec) : 100=65.90%, 250=34.09%, 1000=0.01% 00:19:31.752 cpu : usr=3.31%, sys=10.20%, ctx=29871, majf=0, minf=1 00:19:31.752 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 issued rwts: total=29864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.752 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:31.752 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=663626: Wed Apr 24 15:20:35 2024 00:19:31.752 read: IOPS=8626, BW=33.7MiB/s (35.3MB/s)(98.3MiB/2916msec) 00:19:31.752 slat (usec): min=3, max=11906, avg= 9.07, stdev=89.69 00:19:31.752 clat (usec): min=66, max=379, avg=105.44, stdev=19.37 00:19:31.752 lat (usec): min=71, max=12021, avg=114.51, stdev=91.80 00:19:31.752 clat percentiles (usec): 00:19:31.752 | 1.00th=[ 85], 5.00th=[ 88], 10.00th=[ 90], 20.00th=[ 93], 00:19:31.752 | 30.00th=[ 95], 40.00th=[ 97], 50.00th=[ 99], 60.00th=[ 101], 00:19:31.752 | 70.00th=[ 105], 80.00th=[ 114], 90.00th=[ 143], 95.00th=[ 149], 00:19:31.752 | 99.00th=[ 161], 99.50th=[ 165], 99.90th=[ 194], 99.95th=[ 200], 00:19:31.752 | 99.99th=[ 229] 00:19:31.752 bw ( KiB/s): min=29600, max=37472, per=27.00%, avg=34665.60, stdev=3252.14, samples=5 00:19:31.752 iops : min= 7400, max= 9368, avg=8666.40, stdev=813.04, samples=5 00:19:31.752 lat (usec) : 100=56.79%, 250=43.19%, 500=0.01% 00:19:31.752 cpu : usr=3.09%, sys=8.16%, ctx=25158, majf=0, minf=1 00:19:31.752 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 issued rwts: total=25156,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.752 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:31.752 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=663627: Wed Apr 24 15:20:35 2024 00:19:31.752 read: IOPS=7414, BW=29.0MiB/s (30.4MB/s)(78.9MiB/2723msec) 00:19:31.752 slat (nsec): min=8802, max=54450, avg=9624.22, stdev=1015.64 00:19:31.752 clat (usec): min=82, max=375, avg=123.54, stdev=17.04 00:19:31.752 lat (usec): min=91, max=385, avg=133.17, stdev=17.12 00:19:31.752 clat percentiles (usec): 00:19:31.752 | 1.00th=[ 92], 5.00th=[ 97], 10.00th=[ 100], 20.00th=[ 105], 00:19:31.752 | 30.00th=[ 114], 40.00th=[ 122], 50.00th=[ 127], 60.00th=[ 130], 00:19:31.752 | 70.00th=[ 135], 80.00th=[ 139], 90.00th=[ 145], 95.00th=[ 149], 00:19:31.752 | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 190], 99.95th=[ 194], 00:19:31.752 | 99.99th=[ 258] 00:19:31.752 bw ( KiB/s): min=27480, max=34848, per=23.36%, avg=29992.00, stdev=2824.99, samples=5 00:19:31.752 iops : min= 6870, max= 8712, avg=7498.00, stdev=706.25, samples=5 00:19:31.752 lat (usec) : 100=10.51%, 250=89.47%, 500=0.01% 00:19:31.752 cpu : usr=3.12%, sys=8.38%, ctx=20192, majf=0, minf=2 00:19:31.752 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:31.752 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:31.752 issued rwts: total=20191,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:31.752 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:31.752 00:19:31.752 Run status group 0 (all jobs): 00:19:31.752 READ: bw=125MiB/s (131MB/s), 29.0MiB/s-39.5MiB/s (30.4MB/s-41.4MB/s), io=417MiB (437MB), run=2723-3325msec 00:19:31.752 00:19:31.752 Disk stats (read/write): 00:19:31.752 nvme0n1: ios=31483/0, merge=0/0, ticks=2548/0, in_queue=2548, util=94.76% 00:19:31.752 nvme0n2: ios=27322/0, merge=0/0, ticks=2644/0, in_queue=2644, util=94.71% 00:19:31.752 nvme0n3: ios=24638/0, merge=0/0, ticks=2471/0, in_queue=2471, util=95.91% 00:19:31.752 nvme0n4: ios=19432/0, merge=0/0, ticks=2260/0, in_queue=2260, util=96.48% 00:19:32.018 15:20:35 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:32.018 15:20:35 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:32.303 15:20:36 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:32.303 15:20:36 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:32.585 15:20:36 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:32.585 15:20:36 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:32.585 15:20:36 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:32.585 15:20:36 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:32.886 15:20:36 -- target/fio.sh@69 -- # fio_status=0 00:19:32.886 15:20:36 -- target/fio.sh@70 -- # wait 663501 00:19:32.886 15:20:36 -- target/fio.sh@70 -- # fio_status=4 00:19:32.886 15:20:36 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:33.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:33.834 15:20:37 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:33.834 15:20:37 -- common/autotest_common.sh@1205 -- # local i=0 00:19:33.834 15:20:37 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:33.834 15:20:37 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:33.834 15:20:37 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:33.834 15:20:37 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:33.834 15:20:37 -- common/autotest_common.sh@1217 -- # return 0 00:19:33.834 15:20:37 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:33.834 15:20:37 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:33.834 nvmf hotplug test: fio failed as expected 00:19:33.834 15:20:37 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:33.834 15:20:37 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:33.834 15:20:37 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:33.834 15:20:37 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:33.834 15:20:37 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:33.834 15:20:37 -- target/fio.sh@91 -- # nvmftestfini 00:19:33.834 15:20:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:33.834 15:20:37 -- nvmf/common.sh@117 -- # sync 00:19:33.834 15:20:37 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:33.834 15:20:37 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:33.834 15:20:37 -- nvmf/common.sh@120 -- # set +e 00:19:33.834 15:20:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:33.834 15:20:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:33.834 rmmod nvme_rdma 00:19:33.834 rmmod nvme_fabrics 00:19:33.834 15:20:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:33.834 15:20:37 -- nvmf/common.sh@124 -- # set -e 00:19:33.834 15:20:37 -- nvmf/common.sh@125 -- # return 0 00:19:33.834 15:20:37 -- nvmf/common.sh@478 -- # '[' -n 661381 ']' 00:19:33.834 15:20:37 -- nvmf/common.sh@479 -- # killprocess 661381 00:19:33.834 15:20:37 -- common/autotest_common.sh@936 -- # '[' -z 661381 ']' 00:19:33.834 15:20:37 -- common/autotest_common.sh@940 -- # kill -0 661381 00:19:33.834 15:20:37 -- common/autotest_common.sh@941 -- # uname 00:19:33.834 15:20:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:33.834 15:20:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 661381 00:19:33.834 15:20:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:33.834 15:20:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:33.834 15:20:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 661381' 00:19:33.834 killing process with pid 661381 00:19:33.834 15:20:37 -- common/autotest_common.sh@955 -- # kill 661381 00:19:33.834 15:20:37 -- common/autotest_common.sh@960 -- # wait 661381 00:19:34.094 [2024-04-24 15:20:37.767376] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:34.094 15:20:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:34.094 15:20:37 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:34.094 00:19:34.094 real 0m25.788s 00:19:34.094 user 1m35.500s 00:19:34.094 sys 0m10.170s 00:19:34.094 15:20:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:34.094 15:20:38 -- common/autotest_common.sh@10 -- # set +x 00:19:34.094 ************************************ 00:19:34.094 END TEST nvmf_fio_target 00:19:34.094 ************************************ 00:19:34.353 15:20:38 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:34.353 15:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:34.353 15:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:34.353 15:20:38 -- common/autotest_common.sh@10 -- # set +x 00:19:34.353 ************************************ 00:19:34.353 START TEST nvmf_bdevio 00:19:34.353 ************************************ 00:19:34.353 15:20:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:34.612 * Looking for test storage... 00:19:34.612 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:19:34.612 15:20:38 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:19:34.612 15:20:38 -- nvmf/common.sh@7 -- # uname -s 00:19:34.612 15:20:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:34.612 15:20:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:34.612 15:20:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:34.612 15:20:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:34.612 15:20:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:34.612 15:20:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:34.612 15:20:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:34.612 15:20:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:34.612 15:20:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:34.612 15:20:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:34.612 15:20:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:19:34.612 15:20:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:19:34.612 15:20:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:34.612 15:20:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:34.612 15:20:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:34.612 15:20:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:34.612 15:20:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:19:34.613 15:20:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:34.613 15:20:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:34.613 15:20:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:34.613 15:20:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.613 15:20:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.613 15:20:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.613 15:20:38 -- paths/export.sh@5 -- # export PATH 00:19:34.613 15:20:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:34.613 15:20:38 -- nvmf/common.sh@47 -- # : 0 00:19:34.613 15:20:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:34.613 15:20:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:34.613 15:20:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:34.613 15:20:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:34.613 15:20:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:34.613 15:20:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:34.613 15:20:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:34.613 15:20:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:34.613 15:20:38 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:34.613 15:20:38 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:34.613 15:20:38 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:34.613 15:20:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:34.613 15:20:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:34.613 15:20:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:34.613 15:20:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:34.613 15:20:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:34.613 15:20:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:34.613 15:20:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:34.613 15:20:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:34.613 15:20:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:34.613 15:20:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:34.613 15:20:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:34.613 15:20:38 -- common/autotest_common.sh@10 -- # set +x 00:19:42.752 15:20:45 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:42.752 15:20:45 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:42.752 15:20:45 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:42.752 15:20:45 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:42.752 15:20:45 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:42.752 15:20:45 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:42.752 15:20:45 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:42.752 15:20:45 -- nvmf/common.sh@295 -- # net_devs=() 00:19:42.752 15:20:45 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:42.752 15:20:45 -- nvmf/common.sh@296 -- # e810=() 00:19:42.752 15:20:45 -- nvmf/common.sh@296 -- # local -ga e810 00:19:42.752 15:20:45 -- nvmf/common.sh@297 -- # x722=() 00:19:42.752 15:20:45 -- nvmf/common.sh@297 -- # local -ga x722 00:19:42.752 15:20:45 -- nvmf/common.sh@298 -- # mlx=() 00:19:42.752 15:20:45 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:42.752 15:20:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:42.752 15:20:45 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:19:42.752 Found 0000:18:00.0 (0x8086 - 0x1592) 00:19:42.752 15:20:45 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:42.752 15:20:45 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:19:42.752 Found 0000:18:00.1 (0x8086 - 0x1592) 00:19:42.752 15:20:45 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:42.752 15:20:45 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@377 -- # modinfo irdma 00:19:42.752 15:20:45 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:19:42.752 15:20:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:42.752 15:20:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:42.752 15:20:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:19:42.752 Found net devices under 0000:18:00.0: cvl_0_0 00:19:42.752 15:20:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:42.752 15:20:45 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:42.752 15:20:45 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:19:42.752 Found net devices under 0000:18:00.1: cvl_0_1 00:19:42.752 15:20:45 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:42.752 15:20:45 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:42.752 15:20:45 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:42.752 15:20:45 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:42.752 15:20:45 -- nvmf/common.sh@58 -- # uname 00:19:42.752 15:20:45 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:42.752 15:20:45 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:42.752 15:20:45 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:42.752 15:20:45 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:42.752 15:20:45 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:42.752 15:20:45 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:42.752 15:20:45 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:42.752 15:20:45 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:42.752 15:20:45 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:42.752 15:20:45 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:42.752 15:20:45 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:42.752 15:20:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:42.752 15:20:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:42.752 15:20:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:42.752 15:20:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:42.752 15:20:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:42.752 15:20:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.752 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:42.752 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@105 -- # continue 2 00:19:42.753 15:20:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@105 -- # continue 2 00:19:42.753 15:20:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:42.753 15:20:45 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:42.753 15:20:45 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:42.753 15:20:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:19:42.753 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:42.753 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:19:42.753 altname enp24s0f0np0 00:19:42.753 altname ens785f0np0 00:19:42.753 inet 192.168.100.8/24 scope global cvl_0_0 00:19:42.753 valid_lft forever preferred_lft forever 00:19:42.753 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:19:42.753 valid_lft forever preferred_lft forever 00:19:42.753 15:20:45 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:42.753 15:20:45 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:42.753 15:20:45 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:42.753 15:20:45 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:19:42.753 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:42.753 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:19:42.753 altname enp24s0f1np1 00:19:42.753 altname ens785f1np1 00:19:42.753 inet 192.168.100.9/24 scope global cvl_0_1 00:19:42.753 valid_lft forever preferred_lft forever 00:19:42.753 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:19:42.753 valid_lft forever preferred_lft forever 00:19:42.753 15:20:45 -- nvmf/common.sh@411 -- # return 0 00:19:42.753 15:20:45 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:42.753 15:20:45 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:42.753 15:20:45 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:42.753 15:20:45 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:42.753 15:20:45 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:42.753 15:20:45 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:42.753 15:20:45 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:42.753 15:20:45 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:42.753 15:20:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:42.753 15:20:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@105 -- # continue 2 00:19:42.753 15:20:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:42.753 15:20:45 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:42.753 15:20:45 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@105 -- # continue 2 00:19:42.753 15:20:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:42.753 15:20:45 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:42.753 15:20:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:42.753 15:20:45 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:42.753 15:20:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:42.753 15:20:45 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:42.753 192.168.100.9' 00:19:42.753 15:20:45 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:42.753 192.168.100.9' 00:19:42.753 15:20:45 -- nvmf/common.sh@446 -- # head -n 1 00:19:42.753 15:20:45 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:42.753 15:20:45 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:42.753 192.168.100.9' 00:19:42.753 15:20:45 -- nvmf/common.sh@447 -- # tail -n +2 00:19:42.753 15:20:45 -- nvmf/common.sh@447 -- # head -n 1 00:19:42.753 15:20:45 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:42.753 15:20:45 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:42.753 15:20:45 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:42.753 15:20:45 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:42.753 15:20:45 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:42.753 15:20:45 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:42.753 15:20:45 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:42.753 15:20:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:42.753 15:20:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:42.753 15:20:45 -- common/autotest_common.sh@10 -- # set +x 00:19:42.753 15:20:45 -- nvmf/common.sh@470 -- # nvmfpid=667764 00:19:42.753 15:20:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:42.753 15:20:45 -- nvmf/common.sh@471 -- # waitforlisten 667764 00:19:42.753 15:20:45 -- common/autotest_common.sh@817 -- # '[' -z 667764 ']' 00:19:42.753 15:20:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:42.753 15:20:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:42.753 15:20:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:42.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:42.753 15:20:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:42.753 15:20:45 -- common/autotest_common.sh@10 -- # set +x 00:19:42.753 [2024-04-24 15:20:45.955802] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:19:42.753 [2024-04-24 15:20:45.955855] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:42.753 EAL: No free 2048 kB hugepages reported on node 1 00:19:42.753 [2024-04-24 15:20:46.038913] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:42.753 [2024-04-24 15:20:46.122589] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:42.753 [2024-04-24 15:20:46.122637] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:42.753 [2024-04-24 15:20:46.122646] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:42.753 [2024-04-24 15:20:46.122655] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:42.753 [2024-04-24 15:20:46.122661] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:42.753 [2024-04-24 15:20:46.122782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:42.753 [2024-04-24 15:20:46.122868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:42.753 [2024-04-24 15:20:46.122951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:42.753 [2024-04-24 15:20:46.122952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:43.013 15:20:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:43.013 15:20:46 -- common/autotest_common.sh@850 -- # return 0 00:19:43.013 15:20:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:43.013 15:20:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 15:20:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:43.013 15:20:46 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:43.013 15:20:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 [2024-04-24 15:20:46.842734] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x18cf1f0/0x18ce830) succeed. 00:19:43.013 [2024-04-24 15:20:46.853202] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x18d0560/0x18cedb0) succeed. 00:19:43.013 [2024-04-24 15:20:46.853234] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:19:43.013 15:20:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.013 15:20:46 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:43.013 15:20:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 Malloc0 00:19:43.013 15:20:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.013 15:20:46 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:43.013 15:20:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 15:20:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.013 15:20:46 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:43.013 15:20:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 15:20:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.013 15:20:46 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:43.013 15:20:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.013 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:19:43.013 [2024-04-24 15:20:46.904525] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:43.013 15:20:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.013 15:20:46 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:43.013 15:20:46 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:43.013 15:20:46 -- nvmf/common.sh@521 -- # config=() 00:19:43.013 15:20:46 -- nvmf/common.sh@521 -- # local subsystem config 00:19:43.013 15:20:46 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:43.013 15:20:46 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:43.013 { 00:19:43.013 "params": { 00:19:43.013 "name": "Nvme$subsystem", 00:19:43.013 "trtype": "$TEST_TRANSPORT", 00:19:43.013 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:43.013 "adrfam": "ipv4", 00:19:43.013 "trsvcid": "$NVMF_PORT", 00:19:43.014 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:43.014 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:43.014 "hdgst": ${hdgst:-false}, 00:19:43.014 "ddgst": ${ddgst:-false} 00:19:43.014 }, 00:19:43.014 "method": "bdev_nvme_attach_controller" 00:19:43.014 } 00:19:43.014 EOF 00:19:43.014 )") 00:19:43.014 15:20:46 -- nvmf/common.sh@543 -- # cat 00:19:43.014 15:20:46 -- nvmf/common.sh@545 -- # jq . 00:19:43.014 15:20:46 -- nvmf/common.sh@546 -- # IFS=, 00:19:43.014 15:20:46 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:43.014 "params": { 00:19:43.014 "name": "Nvme1", 00:19:43.014 "trtype": "rdma", 00:19:43.014 "traddr": "192.168.100.8", 00:19:43.014 "adrfam": "ipv4", 00:19:43.014 "trsvcid": "4420", 00:19:43.014 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:43.014 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:43.014 "hdgst": false, 00:19:43.014 "ddgst": false 00:19:43.014 }, 00:19:43.014 "method": "bdev_nvme_attach_controller" 00:19:43.014 }' 00:19:43.273 [2024-04-24 15:20:46.952710] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:19:43.273 [2024-04-24 15:20:46.952764] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid667930 ] 00:19:43.273 EAL: No free 2048 kB hugepages reported on node 1 00:19:43.273 [2024-04-24 15:20:47.033145] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:43.273 [2024-04-24 15:20:47.111814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:43.273 [2024-04-24 15:20:47.111896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:43.273 [2024-04-24 15:20:47.111898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:43.533 I/O targets: 00:19:43.533 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:43.533 00:19:43.533 00:19:43.533 CUnit - A unit testing framework for C - Version 2.1-3 00:19:43.533 http://cunit.sourceforge.net/ 00:19:43.533 00:19:43.533 00:19:43.533 Suite: bdevio tests on: Nvme1n1 00:19:43.533 Test: blockdev write read block ...passed 00:19:43.533 Test: blockdev write zeroes read block ...passed 00:19:43.533 Test: blockdev write zeroes read no split ...passed 00:19:43.533 Test: blockdev write zeroes read split ...passed 00:19:43.533 Test: blockdev write zeroes read split partial ...passed 00:19:43.533 Test: blockdev reset ...[2024-04-24 15:20:47.313152] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:43.533 [2024-04-24 15:20:47.336389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:43.533 [2024-04-24 15:20:47.364902] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:43.533 passed 00:19:43.533 Test: blockdev write read 8 blocks ...passed 00:19:43.533 Test: blockdev write read size > 128k ...passed 00:19:43.533 Test: blockdev write read invalid size ...passed 00:19:43.533 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:43.533 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:43.533 Test: blockdev write read max offset ...passed 00:19:43.533 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:43.533 Test: blockdev writev readv 8 blocks ...passed 00:19:43.533 Test: blockdev writev readv 30 x 1block ...passed 00:19:43.533 Test: blockdev writev readv block ...passed 00:19:43.533 Test: blockdev writev readv size > 128k ...passed 00:19:43.533 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:43.533 Test: blockdev comparev and writev ...[2024-04-24 15:20:47.368196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:43.533 [2024-04-24 15:20:47.368240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:43.533 [2024-04-24 15:20:47.368424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:19:43.533 [2024-04-24 15:20:47.368449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:002a p:0 m:0 dnr:0 00:19:43.533 [2024-04-24 15:20:47.368649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:19:43.533 [2024-04-24 15:20:47.368673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.533 [2024-04-24 15:20:47.368683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:43.534 [2024-04-24 15:20:47.368885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.534 [2024-04-24 15:20:47.368897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:43.534 [2024-04-24 15:20:47.368908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:43.534 [2024-04-24 15:20:47.368918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:43.534 passed 00:19:43.534 Test: blockdev nvme passthru rw ...passed 00:19:43.534 Test: blockdev nvme passthru vendor specific ...[2024-04-24 15:20:47.369215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:43.534 [2024-04-24 15:20:47.369228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:19:43.534 [2024-04-24 15:20:47.369278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:43.534 [2024-04-24 15:20:47.369289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0033 p:0 m:0 dnr:0 00:19:43.534 [2024-04-24 15:20:47.369340] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:43.534 [2024-04-24 15:20:47.369351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0034 p:0 m:0 dnr:0 00:19:43.534 [2024-04-24 15:20:47.369398] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:43.534 [2024-04-24 15:20:47.369409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:19:43.534 passed 00:19:43.534 Test: blockdev nvme admin passthru ...passed 00:19:43.534 Test: blockdev copy ...passed 00:19:43.534 00:19:43.534 Run Summary: Type Total Ran Passed Failed Inactive 00:19:43.534 suites 1 1 n/a 0 0 00:19:43.534 tests 23 23 23 0 0 00:19:43.534 asserts 152 152 152 0 n/a 00:19:43.534 00:19:43.534 Elapsed time = 0.178 seconds 00:19:43.794 15:20:47 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:43.794 15:20:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:43.794 15:20:47 -- common/autotest_common.sh@10 -- # set +x 00:19:43.794 15:20:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:43.794 15:20:47 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:43.794 15:20:47 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:43.794 15:20:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:43.794 15:20:47 -- nvmf/common.sh@117 -- # sync 00:19:43.794 15:20:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:43.794 15:20:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:43.794 15:20:47 -- nvmf/common.sh@120 -- # set +e 00:19:43.794 15:20:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:43.794 15:20:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:43.794 rmmod nvme_rdma 00:19:43.794 rmmod nvme_fabrics 00:19:43.794 15:20:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:43.794 15:20:47 -- nvmf/common.sh@124 -- # set -e 00:19:43.794 15:20:47 -- nvmf/common.sh@125 -- # return 0 00:19:43.794 15:20:47 -- nvmf/common.sh@478 -- # '[' -n 667764 ']' 00:19:43.794 15:20:47 -- nvmf/common.sh@479 -- # killprocess 667764 00:19:43.794 15:20:47 -- common/autotest_common.sh@936 -- # '[' -z 667764 ']' 00:19:43.794 15:20:47 -- common/autotest_common.sh@940 -- # kill -0 667764 00:19:43.794 15:20:47 -- common/autotest_common.sh@941 -- # uname 00:19:43.794 15:20:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:43.794 15:20:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 667764 00:19:44.054 15:20:47 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:44.054 15:20:47 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:44.054 15:20:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 667764' 00:19:44.054 killing process with pid 667764 00:19:44.054 15:20:47 -- common/autotest_common.sh@955 -- # kill 667764 00:19:44.054 15:20:47 -- common/autotest_common.sh@960 -- # wait 667764 00:19:44.054 [2024-04-24 15:20:47.743253] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:44.314 15:20:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:44.314 15:20:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:44.314 00:19:44.314 real 0m9.788s 00:19:44.314 user 0m10.712s 00:19:44.314 sys 0m6.413s 00:19:44.314 15:20:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:44.314 15:20:47 -- common/autotest_common.sh@10 -- # set +x 00:19:44.314 ************************************ 00:19:44.314 END TEST nvmf_bdevio 00:19:44.314 ************************************ 00:19:44.314 15:20:48 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:19:44.314 15:20:48 -- nvmf/nvmf.sh@64 -- # '[' 1 -eq 1 ']' 00:19:44.314 15:20:48 -- nvmf/nvmf.sh@65 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:44.314 15:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:44.314 15:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:44.314 15:20:48 -- common/autotest_common.sh@10 -- # set +x 00:19:44.314 ************************************ 00:19:44.314 START TEST nvmf_fuzz 00:19:44.314 ************************************ 00:19:44.314 15:20:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:44.574 * Looking for test storage... 00:19:44.574 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:19:44.574 15:20:48 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:19:44.574 15:20:48 -- nvmf/common.sh@7 -- # uname -s 00:19:44.574 15:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:44.574 15:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:44.574 15:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:44.574 15:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:44.574 15:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:44.574 15:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:44.574 15:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:44.574 15:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:44.574 15:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:44.574 15:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:44.574 15:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:19:44.574 15:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:19:44.574 15:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:44.574 15:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:44.574 15:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:44.574 15:20:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:44.574 15:20:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:19:44.574 15:20:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:44.574 15:20:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:44.574 15:20:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:44.574 15:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:44.574 15:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:44.575 15:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:44.575 15:20:48 -- paths/export.sh@5 -- # export PATH 00:19:44.575 15:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:44.575 15:20:48 -- nvmf/common.sh@47 -- # : 0 00:19:44.575 15:20:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:44.575 15:20:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:44.575 15:20:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:44.575 15:20:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:44.575 15:20:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:44.575 15:20:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:44.575 15:20:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:44.575 15:20:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:44.575 15:20:48 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:44.575 15:20:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:44.575 15:20:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:44.575 15:20:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:44.575 15:20:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:44.575 15:20:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:44.575 15:20:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:44.575 15:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:44.575 15:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:44.575 15:20:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:44.575 15:20:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:44.575 15:20:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:44.575 15:20:48 -- common/autotest_common.sh@10 -- # set +x 00:19:52.703 15:20:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:52.703 15:20:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:52.703 15:20:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:52.703 15:20:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:52.703 15:20:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:52.703 15:20:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:52.703 15:20:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:52.703 15:20:55 -- nvmf/common.sh@295 -- # net_devs=() 00:19:52.703 15:20:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:52.703 15:20:55 -- nvmf/common.sh@296 -- # e810=() 00:19:52.703 15:20:55 -- nvmf/common.sh@296 -- # local -ga e810 00:19:52.703 15:20:55 -- nvmf/common.sh@297 -- # x722=() 00:19:52.703 15:20:55 -- nvmf/common.sh@297 -- # local -ga x722 00:19:52.703 15:20:55 -- nvmf/common.sh@298 -- # mlx=() 00:19:52.703 15:20:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:52.703 15:20:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:52.703 15:20:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:19:52.703 Found 0000:18:00.0 (0x8086 - 0x1592) 00:19:52.703 15:20:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:52.703 15:20:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:19:52.703 Found 0000:18:00.1 (0x8086 - 0x1592) 00:19:52.703 15:20:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:52.703 15:20:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@377 -- # modinfo irdma 00:19:52.703 15:20:55 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:19:52.703 15:20:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.703 15:20:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.703 15:20:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:19:52.703 Found net devices under 0000:18:00.0: cvl_0_0 00:19:52.703 15:20:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:52.703 15:20:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:52.703 15:20:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:19:52.703 Found net devices under 0000:18:00.1: cvl_0_1 00:19:52.703 15:20:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:52.703 15:20:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:52.703 15:20:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:52.703 15:20:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:52.703 15:20:55 -- nvmf/common.sh@58 -- # uname 00:19:52.703 15:20:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:52.703 15:20:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:52.703 15:20:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:52.703 15:20:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:52.703 15:20:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:52.703 15:20:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:52.703 15:20:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:52.703 15:20:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:52.703 15:20:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:52.703 15:20:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:52.703 15:20:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:52.703 15:20:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:52.703 15:20:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:52.703 15:20:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:52.703 15:20:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:52.703 15:20:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:52.703 15:20:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:52.703 15:20:55 -- nvmf/common.sh@105 -- # continue 2 00:19:52.703 15:20:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.703 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:52.703 15:20:55 -- nvmf/common.sh@105 -- # continue 2 00:19:52.703 15:20:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:52.703 15:20:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:19:52.703 15:20:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:52.703 15:20:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:52.703 15:20:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:19:52.703 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:52.703 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:19:52.703 altname enp24s0f0np0 00:19:52.703 altname ens785f0np0 00:19:52.703 inet 192.168.100.8/24 scope global cvl_0_0 00:19:52.703 valid_lft forever preferred_lft forever 00:19:52.703 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:19:52.703 valid_lft forever preferred_lft forever 00:19:52.703 15:20:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:52.703 15:20:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:19:52.703 15:20:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:52.703 15:20:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:52.703 15:20:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:52.703 15:20:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:19:52.703 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:19:52.703 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:19:52.703 altname enp24s0f1np1 00:19:52.703 altname ens785f1np1 00:19:52.703 inet 192.168.100.9/24 scope global cvl_0_1 00:19:52.703 valid_lft forever preferred_lft forever 00:19:52.703 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:19:52.703 valid_lft forever preferred_lft forever 00:19:52.703 15:20:55 -- nvmf/common.sh@411 -- # return 0 00:19:52.703 15:20:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:52.703 15:20:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:52.703 15:20:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:52.703 15:20:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:52.703 15:20:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:52.703 15:20:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:52.704 15:20:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:52.704 15:20:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:52.704 15:20:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:52.704 15:20:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:52.704 15:20:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:52.704 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.704 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:19:52.704 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.704 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:19:52.704 15:20:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:19:52.704 15:20:55 -- nvmf/common.sh@105 -- # continue 2 00:19:52.704 15:20:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:52.704 15:20:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:52.704 15:20:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:19:52.704 15:20:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:19:52.704 15:20:55 -- nvmf/common.sh@105 -- # continue 2 00:19:52.704 15:20:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:52.704 15:20:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:19:52.704 15:20:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:52.704 15:20:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:52.704 15:20:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:19:52.704 15:20:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:52.704 15:20:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:52.704 15:20:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:52.704 192.168.100.9' 00:19:52.704 15:20:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:52.704 192.168.100.9' 00:19:52.704 15:20:55 -- nvmf/common.sh@446 -- # head -n 1 00:19:52.704 15:20:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:52.704 15:20:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:52.704 192.168.100.9' 00:19:52.704 15:20:55 -- nvmf/common.sh@447 -- # tail -n +2 00:19:52.704 15:20:55 -- nvmf/common.sh@447 -- # head -n 1 00:19:52.704 15:20:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:52.704 15:20:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:52.704 15:20:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:52.704 15:20:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:52.704 15:20:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:52.704 15:20:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:52.704 15:20:55 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=671463 00:19:52.704 15:20:55 -- target/fabrics_fuzz.sh@13 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:19:52.704 15:20:55 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:52.704 15:20:55 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 671463 00:19:52.704 15:20:55 -- common/autotest_common.sh@817 -- # '[' -z 671463 ']' 00:19:52.704 15:20:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:52.704 15:20:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:52.704 15:20:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:52.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:52.704 15:20:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:52.704 15:20:55 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 15:20:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:52.704 15:20:56 -- common/autotest_common.sh@850 -- # return 0 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:52.704 15:20:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.704 15:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 15:20:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:19:52.704 15:20:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.704 15:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 Malloc0 00:19:52.704 15:20:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:52.704 15:20:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.704 15:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 15:20:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:52.704 15:20:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.704 15:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 15:20:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:52.704 15:20:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:52.704 15:20:56 -- common/autotest_common.sh@10 -- # set +x 00:19:52.704 15:20:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' 00:19:52.704 15:20:56 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -N -a 00:20:24.782 Fuzzing completed. Shutting down the fuzz application 00:20:24.782 00:20:24.782 Dumping successful admin opcodes: 00:20:24.782 8, 9, 10, 24, 00:20:24.782 Dumping successful io opcodes: 00:20:24.782 0, 9, 00:20:24.782 NS: 0x200003af1f00 I/O qp, Total commands completed: 952509, total successful commands: 5565, random_seed: 1480785792 00:20:24.782 NS: 0x200003af1f00 admin qp, Total commands completed: 120128, total successful commands: 984, random_seed: 1943296256 00:20:24.782 15:21:27 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -j /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:20:24.782 Fuzzing completed. Shutting down the fuzz application 00:20:24.782 00:20:24.782 Dumping successful admin opcodes: 00:20:24.782 24, 00:20:24.782 Dumping successful io opcodes: 00:20:24.782 00:20:24.782 NS: 0x200003af1f00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1779962362 00:20:24.782 NS: 0x200003af1f00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1780034698 00:20:24.782 15:21:28 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:24.782 15:21:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.782 15:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:24.782 15:21:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.782 15:21:28 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:20:24.782 15:21:28 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:20:24.782 15:21:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:24.782 15:21:28 -- nvmf/common.sh@117 -- # sync 00:20:24.782 15:21:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:24.782 15:21:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:24.782 15:21:28 -- nvmf/common.sh@120 -- # set +e 00:20:24.782 15:21:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:24.782 15:21:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:24.782 rmmod nvme_rdma 00:20:24.782 rmmod nvme_fabrics 00:20:24.782 15:21:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:24.782 15:21:28 -- nvmf/common.sh@124 -- # set -e 00:20:24.782 15:21:28 -- nvmf/common.sh@125 -- # return 0 00:20:24.783 15:21:28 -- nvmf/common.sh@478 -- # '[' -n 671463 ']' 00:20:24.783 15:21:28 -- nvmf/common.sh@479 -- # killprocess 671463 00:20:24.783 15:21:28 -- common/autotest_common.sh@936 -- # '[' -z 671463 ']' 00:20:24.783 15:21:28 -- common/autotest_common.sh@940 -- # kill -0 671463 00:20:24.783 15:21:28 -- common/autotest_common.sh@941 -- # uname 00:20:24.783 15:21:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:24.783 15:21:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 671463 00:20:24.783 15:21:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:24.783 15:21:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:24.783 15:21:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 671463' 00:20:24.783 killing process with pid 671463 00:20:24.783 15:21:28 -- common/autotest_common.sh@955 -- # kill 671463 00:20:24.783 15:21:28 -- common/autotest_common.sh@960 -- # wait 671463 00:20:25.042 15:21:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:25.042 15:21:28 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:25.042 15:21:28 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:20:25.042 00:20:25.042 real 0m40.586s 00:20:25.042 user 0m50.334s 00:20:25.042 sys 0m21.305s 00:20:25.042 15:21:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:25.042 15:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.042 ************************************ 00:20:25.042 END TEST nvmf_fuzz 00:20:25.042 ************************************ 00:20:25.042 15:21:28 -- nvmf/nvmf.sh@66 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:25.042 15:21:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:25.042 15:21:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:25.042 15:21:28 -- common/autotest_common.sh@10 -- # set +x 00:20:25.300 ************************************ 00:20:25.300 START TEST nvmf_multiconnection 00:20:25.300 ************************************ 00:20:25.300 15:21:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:25.300 * Looking for test storage... 00:20:25.300 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:20:25.300 15:21:29 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:20:25.300 15:21:29 -- nvmf/common.sh@7 -- # uname -s 00:20:25.300 15:21:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:25.300 15:21:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:25.300 15:21:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:25.300 15:21:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:25.300 15:21:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:25.300 15:21:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:25.300 15:21:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:25.300 15:21:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:25.300 15:21:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:25.300 15:21:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:25.300 15:21:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:20:25.300 15:21:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:20:25.300 15:21:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:25.300 15:21:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:25.300 15:21:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:25.300 15:21:29 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:25.300 15:21:29 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:20:25.300 15:21:29 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:25.300 15:21:29 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:25.300 15:21:29 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:25.300 15:21:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.300 15:21:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.300 15:21:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.300 15:21:29 -- paths/export.sh@5 -- # export PATH 00:20:25.300 15:21:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.300 15:21:29 -- nvmf/common.sh@47 -- # : 0 00:20:25.300 15:21:29 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:25.300 15:21:29 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:25.300 15:21:29 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:25.300 15:21:29 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:25.300 15:21:29 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:25.300 15:21:29 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:25.300 15:21:29 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:25.300 15:21:29 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:25.300 15:21:29 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:25.300 15:21:29 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:25.300 15:21:29 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:20:25.300 15:21:29 -- target/multiconnection.sh@16 -- # nvmftestinit 00:20:25.300 15:21:29 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:25.300 15:21:29 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:25.300 15:21:29 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:25.300 15:21:29 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:25.300 15:21:29 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:25.300 15:21:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:25.300 15:21:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:25.300 15:21:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:25.300 15:21:29 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:25.300 15:21:29 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:25.300 15:21:29 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:25.300 15:21:29 -- common/autotest_common.sh@10 -- # set +x 00:20:33.423 15:21:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:33.423 15:21:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:33.423 15:21:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:33.423 15:21:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:33.423 15:21:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:33.423 15:21:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:33.423 15:21:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:33.423 15:21:35 -- nvmf/common.sh@295 -- # net_devs=() 00:20:33.423 15:21:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:33.423 15:21:35 -- nvmf/common.sh@296 -- # e810=() 00:20:33.423 15:21:35 -- nvmf/common.sh@296 -- # local -ga e810 00:20:33.423 15:21:35 -- nvmf/common.sh@297 -- # x722=() 00:20:33.423 15:21:35 -- nvmf/common.sh@297 -- # local -ga x722 00:20:33.423 15:21:35 -- nvmf/common.sh@298 -- # mlx=() 00:20:33.423 15:21:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:33.423 15:21:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:33.423 15:21:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:33.423 15:21:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:20:33.423 Found 0000:18:00.0 (0x8086 - 0x1592) 00:20:33.423 15:21:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:33.423 15:21:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:33.423 15:21:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:20:33.423 Found 0000:18:00.1 (0x8086 - 0x1592) 00:20:33.423 15:21:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:33.423 15:21:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@377 -- # modinfo irdma 00:20:33.423 15:21:35 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:20:33.423 15:21:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:33.423 15:21:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:33.423 15:21:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:33.423 15:21:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:20:33.423 Found net devices under 0000:18:00.0: cvl_0_0 00:20:33.423 15:21:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:33.423 15:21:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:33.423 15:21:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:33.423 15:21:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:20:33.423 Found net devices under 0000:18:00.1: cvl_0_1 00:20:33.423 15:21:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:33.423 15:21:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:33.423 15:21:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:33.423 15:21:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:33.423 15:21:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:33.423 15:21:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:33.423 15:21:35 -- nvmf/common.sh@58 -- # uname 00:20:33.423 15:21:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:33.423 15:21:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:33.423 15:21:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:33.423 15:21:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:33.423 15:21:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:33.423 15:21:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:33.423 15:21:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:33.423 15:21:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:33.423 15:21:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:33.423 15:21:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:33.423 15:21:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:33.423 15:21:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:33.423 15:21:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:33.423 15:21:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:33.423 15:21:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:33.423 15:21:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:33.423 15:21:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:33.423 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.423 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:20:33.423 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.423 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@105 -- # continue 2 00:20:33.424 15:21:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@105 -- # continue 2 00:20:33.424 15:21:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:33.424 15:21:36 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:33.424 15:21:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:33.424 15:21:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:20:33.424 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:20:33.424 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:20:33.424 altname enp24s0f0np0 00:20:33.424 altname ens785f0np0 00:20:33.424 inet 192.168.100.8/24 scope global cvl_0_0 00:20:33.424 valid_lft forever preferred_lft forever 00:20:33.424 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:20:33.424 valid_lft forever preferred_lft forever 00:20:33.424 15:21:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:33.424 15:21:36 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:33.424 15:21:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:33.424 15:21:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:20:33.424 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:20:33.424 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:20:33.424 altname enp24s0f1np1 00:20:33.424 altname ens785f1np1 00:20:33.424 inet 192.168.100.9/24 scope global cvl_0_1 00:20:33.424 valid_lft forever preferred_lft forever 00:20:33.424 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:20:33.424 valid_lft forever preferred_lft forever 00:20:33.424 15:21:36 -- nvmf/common.sh@411 -- # return 0 00:20:33.424 15:21:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:33.424 15:21:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:33.424 15:21:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:33.424 15:21:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:33.424 15:21:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:33.424 15:21:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:33.424 15:21:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:33.424 15:21:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:33.424 15:21:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:33.424 15:21:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@105 -- # continue 2 00:20:33.424 15:21:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:33.424 15:21:36 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:20:33.424 15:21:36 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@105 -- # continue 2 00:20:33.424 15:21:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:33.424 15:21:36 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:33.424 15:21:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:33.424 15:21:36 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:33.424 15:21:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:33.424 15:21:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:33.424 192.168.100.9' 00:20:33.424 15:21:36 -- nvmf/common.sh@446 -- # head -n 1 00:20:33.424 15:21:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:33.424 192.168.100.9' 00:20:33.424 15:21:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:33.424 15:21:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:33.424 192.168.100.9' 00:20:33.424 15:21:36 -- nvmf/common.sh@447 -- # tail -n +2 00:20:33.424 15:21:36 -- nvmf/common.sh@447 -- # head -n 1 00:20:33.424 15:21:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:33.424 15:21:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:33.424 15:21:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:33.424 15:21:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:33.424 15:21:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:33.424 15:21:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:33.424 15:21:36 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:20:33.424 15:21:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:33.424 15:21:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:33.424 15:21:36 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 15:21:36 -- nvmf/common.sh@470 -- # nvmfpid=679537 00:20:33.424 15:21:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:33.424 15:21:36 -- nvmf/common.sh@471 -- # waitforlisten 679537 00:20:33.424 15:21:36 -- common/autotest_common.sh@817 -- # '[' -z 679537 ']' 00:20:33.424 15:21:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:33.424 15:21:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:33.424 15:21:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:33.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:33.424 15:21:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:33.424 15:21:36 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 [2024-04-24 15:21:36.201549] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:20:33.424 [2024-04-24 15:21:36.201603] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:33.424 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.424 [2024-04-24 15:21:36.284398] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:33.424 [2024-04-24 15:21:36.368982] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:33.424 [2024-04-24 15:21:36.369029] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:33.424 [2024-04-24 15:21:36.369038] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:33.424 [2024-04-24 15:21:36.369046] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:33.424 [2024-04-24 15:21:36.369053] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:33.424 [2024-04-24 15:21:36.369144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:33.424 [2024-04-24 15:21:36.369230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:33.424 [2024-04-24 15:21:36.369303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:33.424 [2024-04-24 15:21:36.369304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:33.424 15:21:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:33.424 15:21:37 -- common/autotest_common.sh@850 -- # return 0 00:20:33.424 15:21:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:33.424 15:21:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:33.424 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 15:21:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:33.424 15:21:37 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:33.424 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.424 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 [2024-04-24 15:21:37.090628] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x101d910/0x101cf50) succeed. 00:20:33.424 [2024-04-24 15:21:37.101043] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x101ec80/0x101d4d0) succeed. 00:20:33.424 [2024-04-24 15:21:37.101070] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:20:33.424 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.424 15:21:37 -- target/multiconnection.sh@21 -- # seq 1 11 00:20:33.424 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.424 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:33.424 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.424 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 Malloc1 00:20:33.424 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.424 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:20:33.424 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.424 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.424 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:33.424 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.424 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.424 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.424 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:33.424 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 [2024-04-24 15:21:37.166981] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.425 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 Malloc2 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.425 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 Malloc3 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.425 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 Malloc4 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.425 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.425 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.425 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:20:33.425 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.425 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 Malloc5 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.684 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 Malloc6 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.684 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.684 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.684 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t rdma -a 192.168.100.8 -s 4420 00:20:33.684 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.685 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 Malloc7 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t rdma -a 192.168.100.8 -s 4420 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.685 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 Malloc8 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t rdma -a 192.168.100.8 -s 4420 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.685 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 Malloc9 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t rdma -a 192.168.100.8 -s 4420 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.685 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.685 Malloc10 00:20:33.685 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.685 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:20:33.685 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.685 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t rdma -a 192.168.100.8 -s 4420 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.945 15:21:37 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 Malloc11 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t rdma -a 192.168.100.8 -s 4420 00:20:33.945 15:21:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.945 15:21:37 -- common/autotest_common.sh@10 -- # set +x 00:20:33.945 15:21:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.945 15:21:37 -- target/multiconnection.sh@28 -- # seq 1 11 00:20:33.945 15:21:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:33.945 15:21:37 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:20:34.204 15:21:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:20:34.204 15:21:37 -- common/autotest_common.sh@1184 -- # local i=0 00:20:34.204 15:21:37 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:34.204 15:21:37 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:34.204 15:21:37 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:36.113 15:21:39 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:36.113 15:21:39 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:36.113 15:21:39 -- common/autotest_common.sh@1193 -- # grep -c SPDK1 00:20:36.113 15:21:39 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:36.113 15:21:39 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:36.113 15:21:39 -- common/autotest_common.sh@1194 -- # return 0 00:20:36.113 15:21:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:36.113 15:21:39 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:20:36.372 15:21:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:20:36.372 15:21:40 -- common/autotest_common.sh@1184 -- # local i=0 00:20:36.372 15:21:40 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:36.372 15:21:40 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:36.372 15:21:40 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:38.279 15:21:42 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:38.279 15:21:42 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:38.279 15:21:42 -- common/autotest_common.sh@1193 -- # grep -c SPDK2 00:20:38.279 15:21:42 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:38.279 15:21:42 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:38.279 15:21:42 -- common/autotest_common.sh@1194 -- # return 0 00:20:38.279 15:21:42 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:38.279 15:21:42 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:20:38.543 15:21:42 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:20:38.543 15:21:42 -- common/autotest_common.sh@1184 -- # local i=0 00:20:38.543 15:21:42 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:38.543 15:21:42 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:38.543 15:21:42 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:41.082 15:21:44 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:41.082 15:21:44 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:41.082 15:21:44 -- common/autotest_common.sh@1193 -- # grep -c SPDK3 00:20:41.082 15:21:44 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:41.082 15:21:44 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:41.082 15:21:44 -- common/autotest_common.sh@1194 -- # return 0 00:20:41.082 15:21:44 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:41.082 15:21:44 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:20:41.082 15:21:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:20:41.082 15:21:44 -- common/autotest_common.sh@1184 -- # local i=0 00:20:41.082 15:21:44 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:41.082 15:21:44 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:41.082 15:21:44 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:42.989 15:21:46 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:42.989 15:21:46 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:42.990 15:21:46 -- common/autotest_common.sh@1193 -- # grep -c SPDK4 00:20:42.990 15:21:46 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:42.990 15:21:46 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:42.990 15:21:46 -- common/autotest_common.sh@1194 -- # return 0 00:20:42.990 15:21:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.990 15:21:46 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:20:42.990 15:21:46 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:20:42.990 15:21:46 -- common/autotest_common.sh@1184 -- # local i=0 00:20:42.990 15:21:46 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:42.990 15:21:46 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:42.990 15:21:46 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:45.529 15:21:48 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:45.529 15:21:48 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:45.529 15:21:48 -- common/autotest_common.sh@1193 -- # grep -c SPDK5 00:20:45.529 15:21:48 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:45.529 15:21:48 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:45.529 15:21:48 -- common/autotest_common.sh@1194 -- # return 0 00:20:45.529 15:21:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:45.529 15:21:48 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode6 -a 192.168.100.8 -s 4420 00:20:45.529 15:21:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:20:45.529 15:21:49 -- common/autotest_common.sh@1184 -- # local i=0 00:20:45.529 15:21:49 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:45.529 15:21:49 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:45.529 15:21:49 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:47.439 15:21:51 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:47.439 15:21:51 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:47.439 15:21:51 -- common/autotest_common.sh@1193 -- # grep -c SPDK6 00:20:47.439 15:21:51 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:47.439 15:21:51 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:47.439 15:21:51 -- common/autotest_common.sh@1194 -- # return 0 00:20:47.439 15:21:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.439 15:21:51 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode7 -a 192.168.100.8 -s 4420 00:20:47.698 15:21:51 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:20:47.698 15:21:51 -- common/autotest_common.sh@1184 -- # local i=0 00:20:47.698 15:21:51 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:47.698 15:21:51 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:47.698 15:21:51 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:49.605 15:21:53 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:49.605 15:21:53 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:49.605 15:21:53 -- common/autotest_common.sh@1193 -- # grep -c SPDK7 00:20:49.605 15:21:53 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:49.605 15:21:53 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:49.605 15:21:53 -- common/autotest_common.sh@1194 -- # return 0 00:20:49.605 15:21:53 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:49.605 15:21:53 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode8 -a 192.168.100.8 -s 4420 00:20:49.865 15:21:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:20:49.865 15:21:53 -- common/autotest_common.sh@1184 -- # local i=0 00:20:49.865 15:21:53 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:49.865 15:21:53 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:49.865 15:21:53 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:51.770 15:21:55 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:51.770 15:21:55 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:51.770 15:21:55 -- common/autotest_common.sh@1193 -- # grep -c SPDK8 00:20:51.770 15:21:55 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:51.770 15:21:55 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:51.770 15:21:55 -- common/autotest_common.sh@1194 -- # return 0 00:20:51.770 15:21:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:51.770 15:21:55 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode9 -a 192.168.100.8 -s 4420 00:20:52.029 15:21:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:20:52.029 15:21:55 -- common/autotest_common.sh@1184 -- # local i=0 00:20:52.029 15:21:55 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:52.030 15:21:55 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:52.030 15:21:55 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:54.565 15:21:57 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:54.565 15:21:57 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:54.565 15:21:57 -- common/autotest_common.sh@1193 -- # grep -c SPDK9 00:20:54.565 15:21:57 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:54.565 15:21:57 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:54.565 15:21:57 -- common/autotest_common.sh@1194 -- # return 0 00:20:54.565 15:21:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:54.565 15:21:57 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode10 -a 192.168.100.8 -s 4420 00:20:54.565 15:21:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:54.565 15:21:58 -- common/autotest_common.sh@1184 -- # local i=0 00:20:54.565 15:21:58 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:54.565 15:21:58 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:54.565 15:21:58 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:56.471 15:22:00 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:56.471 15:22:00 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:56.471 15:22:00 -- common/autotest_common.sh@1193 -- # grep -c SPDK10 00:20:56.471 15:22:00 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:56.471 15:22:00 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:56.471 15:22:00 -- common/autotest_common.sh@1194 -- # return 0 00:20:56.471 15:22:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:56.471 15:22:00 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode11 -a 192.168.100.8 -s 4420 00:20:56.729 15:22:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:56.729 15:22:00 -- common/autotest_common.sh@1184 -- # local i=0 00:20:56.729 15:22:00 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:56.729 15:22:00 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:56.729 15:22:00 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:58.642 15:22:02 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:58.642 15:22:02 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:58.642 15:22:02 -- common/autotest_common.sh@1193 -- # grep -c SPDK11 00:20:58.642 15:22:02 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:58.642 15:22:02 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:58.642 15:22:02 -- common/autotest_common.sh@1194 -- # return 0 00:20:58.642 15:22:02 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:58.642 [global] 00:20:58.642 thread=1 00:20:58.642 invalidate=1 00:20:58.642 rw=read 00:20:58.642 time_based=1 00:20:58.642 runtime=10 00:20:58.642 ioengine=libaio 00:20:58.642 direct=1 00:20:58.642 bs=262144 00:20:58.642 iodepth=64 00:20:58.642 norandommap=1 00:20:58.642 numjobs=1 00:20:58.642 00:20:58.642 [job0] 00:20:58.642 filename=/dev/nvme0n1 00:20:58.642 [job1] 00:20:58.642 filename=/dev/nvme10n1 00:20:58.642 [job2] 00:20:58.642 filename=/dev/nvme1n1 00:20:58.642 [job3] 00:20:58.642 filename=/dev/nvme2n1 00:20:58.642 [job4] 00:20:58.642 filename=/dev/nvme3n1 00:20:58.642 [job5] 00:20:58.642 filename=/dev/nvme4n1 00:20:58.642 [job6] 00:20:58.642 filename=/dev/nvme5n1 00:20:58.642 [job7] 00:20:58.642 filename=/dev/nvme6n1 00:20:58.642 [job8] 00:20:58.642 filename=/dev/nvme7n1 00:20:58.642 [job9] 00:20:58.642 filename=/dev/nvme8n1 00:20:58.642 [job10] 00:20:58.642 filename=/dev/nvme9n1 00:20:58.901 Could not set queue depth (nvme0n1) 00:20:58.901 Could not set queue depth (nvme10n1) 00:20:58.901 Could not set queue depth (nvme1n1) 00:20:58.901 Could not set queue depth (nvme2n1) 00:20:58.901 Could not set queue depth (nvme3n1) 00:20:58.901 Could not set queue depth (nvme4n1) 00:20:58.901 Could not set queue depth (nvme5n1) 00:20:58.901 Could not set queue depth (nvme6n1) 00:20:58.901 Could not set queue depth (nvme7n1) 00:20:58.901 Could not set queue depth (nvme8n1) 00:20:58.901 Could not set queue depth (nvme9n1) 00:20:59.160 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:59.160 fio-3.35 00:20:59.161 Starting 11 threads 00:21:11.367 00:21:11.367 job0: (groupid=0, jobs=1): err= 0: pid=683328: Wed Apr 24 15:22:13 2024 00:21:11.367 read: IOPS=1570, BW=393MiB/s (412MB/s)(3934MiB/10021msec) 00:21:11.367 slat (usec): min=10, max=15834, avg=617.90, stdev=1500.85 00:21:11.367 clat (msec): min=16, max=103, avg=40.10, stdev=14.43 00:21:11.367 lat (msec): min=17, max=103, avg=40.72, stdev=14.67 00:21:11.367 clat percentiles (msec): 00:21:11.367 | 1.00th=[ 24], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 26], 00:21:11.367 | 30.00th=[ 27], 40.00th=[ 37], 50.00th=[ 38], 60.00th=[ 42], 00:21:11.367 | 70.00th=[ 50], 80.00th=[ 52], 90.00th=[ 62], 95.00th=[ 64], 00:21:11.367 | 99.00th=[ 86], 99.50th=[ 89], 99.90th=[ 96], 99.95th=[ 99], 00:21:11.367 | 99.99th=[ 101] 00:21:11.367 bw ( KiB/s): min=179046, max=641024, per=7.98%, avg=401099.80, stdev=137256.97, samples=20 00:21:11.367 iops : min= 699, max= 2504, avg=1566.70, stdev=536.25, samples=20 00:21:11.367 lat (msec) : 20=0.05%, 50=71.87%, 100=28.06%, 250=0.02% 00:21:11.367 cpu : usr=0.35%, sys=3.13%, ctx=4068, majf=0, minf=4097 00:21:11.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:11.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.367 issued rwts: total=15734,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.367 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.367 job1: (groupid=0, jobs=1): err= 0: pid=683346: Wed Apr 24 15:22:13 2024 00:21:11.367 read: IOPS=1598, BW=400MiB/s (419MB/s)(4008MiB/10030msec) 00:21:11.367 slat (usec): min=11, max=25531, avg=602.11, stdev=1503.46 00:21:11.367 clat (msec): min=10, max=112, avg=39.40, stdev=14.44 00:21:11.367 lat (msec): min=10, max=113, avg=40.00, stdev=14.70 00:21:11.367 clat percentiles (msec): 00:21:11.367 | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 26], 00:21:11.367 | 30.00th=[ 27], 40.00th=[ 37], 50.00th=[ 39], 60.00th=[ 41], 00:21:11.367 | 70.00th=[ 50], 80.00th=[ 51], 90.00th=[ 56], 95.00th=[ 64], 00:21:11.367 | 99.00th=[ 86], 99.50th=[ 89], 99.90th=[ 91], 99.95th=[ 93], 00:21:11.367 | 99.99th=[ 113] 00:21:11.367 bw ( KiB/s): min=194048, max=803840, per=8.13%, avg=408767.20, stdev=147117.85, samples=20 00:21:11.367 iops : min= 758, max= 3140, avg=1596.70, stdev=574.60, samples=20 00:21:11.367 lat (msec) : 20=5.08%, 50=68.88%, 100=26.02%, 250=0.02% 00:21:11.367 cpu : usr=0.38%, sys=3.69%, ctx=4372, majf=0, minf=4097 00:21:11.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:11.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.367 issued rwts: total=16033,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.367 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.367 job2: (groupid=0, jobs=1): err= 0: pid=683357: Wed Apr 24 15:22:13 2024 00:21:11.367 read: IOPS=1377, BW=344MiB/s (361MB/s)(3458MiB/10042msec) 00:21:11.367 slat (usec): min=11, max=19035, avg=698.64, stdev=1752.64 00:21:11.367 clat (msec): min=11, max=110, avg=45.72, stdev=14.58 00:21:11.367 lat (msec): min=11, max=110, avg=46.41, stdev=14.88 00:21:11.367 clat percentiles (msec): 00:21:11.367 | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 26], 20.00th=[ 31], 00:21:11.367 | 30.00th=[ 38], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 51], 00:21:11.367 | 70.00th=[ 52], 80.00th=[ 58], 90.00th=[ 64], 95.00th=[ 66], 00:21:11.367 | 99.00th=[ 87], 99.50th=[ 89], 99.90th=[ 97], 99.95th=[ 104], 00:21:11.367 | 99.99th=[ 108] 00:21:11.367 bw ( KiB/s): min=206749, max=638464, per=7.01%, avg=352441.35, stdev=109232.62, samples=20 00:21:11.367 iops : min= 807, max= 2494, avg=1376.60, stdev=426.78, samples=20 00:21:11.367 lat (msec) : 20=1.27%, 50=54.99%, 100=43.64%, 250=0.09% 00:21:11.367 cpu : usr=0.33%, sys=3.70%, ctx=3709, majf=0, minf=4097 00:21:11.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:11.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.367 issued rwts: total=13833,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.367 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.367 job3: (groupid=0, jobs=1): err= 0: pid=683365: Wed Apr 24 15:22:13 2024 00:21:11.367 read: IOPS=2088, BW=522MiB/s (547MB/s)(5244MiB/10044msec) 00:21:11.367 slat (usec): min=11, max=31183, avg=469.49, stdev=1436.90 00:21:11.367 clat (usec): min=801, max=107926, avg=30141.25, stdev=17741.37 00:21:11.367 lat (usec): min=822, max=107937, avg=30610.73, stdev=18048.12 00:21:11.367 clat percentiles (msec): 00:21:11.367 | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 13], 00:21:11.367 | 30.00th=[ 14], 40.00th=[ 25], 50.00th=[ 26], 60.00th=[ 27], 00:21:11.367 | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 55], 95.00th=[ 64], 00:21:11.367 | 99.00th=[ 69], 99.50th=[ 71], 99.90th=[ 94], 99.95th=[ 97], 00:21:11.367 | 99.99th=[ 104] 00:21:11.367 bw ( KiB/s): min=240640, max=1276416, per=10.66%, avg=535465.90, stdev=343964.32, samples=20 00:21:11.367 iops : min= 940, max= 4986, avg=2091.60, stdev=1343.54, samples=20 00:21:11.367 lat (usec) : 1000=0.01% 00:21:11.367 lat (msec) : 2=0.06%, 4=0.15%, 10=0.35%, 20=35.68%, 50=41.75% 00:21:11.367 lat (msec) : 100=21.98%, 250=0.02% 00:21:11.367 cpu : usr=0.23%, sys=3.79%, ctx=5323, majf=0, minf=4097 00:21:11.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:11.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.367 issued rwts: total=20976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.367 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.367 job4: (groupid=0, jobs=1): err= 0: pid=683370: Wed Apr 24 15:22:13 2024 00:21:11.367 read: IOPS=1543, BW=386MiB/s (405MB/s)(3871MiB/10030msec) 00:21:11.367 slat (usec): min=10, max=25409, avg=637.96, stdev=1560.20 00:21:11.367 clat (msec): min=12, max=109, avg=40.77, stdev=13.54 00:21:11.368 lat (msec): min=12, max=110, avg=41.41, stdev=13.79 00:21:11.368 clat percentiles (usec): 00:21:11.368 | 1.00th=[22938], 5.00th=[24511], 10.00th=[25035], 20.00th=[25822], 00:21:11.368 | 30.00th=[31327], 40.00th=[37487], 50.00th=[38536], 60.00th=[41157], 00:21:11.368 | 70.00th=[49546], 80.00th=[51119], 90.00th=[57934], 95.00th=[63177], 00:21:11.368 | 99.00th=[85459], 99.50th=[88605], 99.90th=[89654], 99.95th=[91751], 00:21:11.368 | 99.99th=[95945] 00:21:11.368 bw ( KiB/s): min=193024, max=645632, per=7.86%, avg=394738.95, stdev=124464.00, samples=20 00:21:11.368 iops : min= 754, max= 2522, avg=1541.90, stdev=486.08, samples=20 00:21:11.368 lat (msec) : 20=0.57%, 50=71.88%, 100=27.54%, 250=0.01% 00:21:11.368 cpu : usr=0.27%, sys=3.00%, ctx=3939, majf=0, minf=4097 00:21:11.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:11.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.368 issued rwts: total=15485,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.368 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.368 job5: (groupid=0, jobs=1): err= 0: pid=683387: Wed Apr 24 15:22:13 2024 00:21:11.368 read: IOPS=2404, BW=601MiB/s (630MB/s)(6030MiB/10031msec) 00:21:11.368 slat (usec): min=11, max=10018, avg=410.33, stdev=899.49 00:21:11.368 clat (usec): min=816, max=89575, avg=26177.05, stdev=10194.40 00:21:11.368 lat (usec): min=847, max=93033, avg=26587.38, stdev=10361.37 00:21:11.368 clat percentiles (usec): 00:21:11.368 | 1.00th=[ 6718], 5.00th=[12256], 10.00th=[12649], 20.00th=[20055], 00:21:11.368 | 30.00th=[24773], 40.00th=[25035], 50.00th=[25560], 60.00th=[25822], 00:21:11.368 | 70.00th=[26346], 80.00th=[28181], 90.00th=[39060], 95.00th=[49546], 00:21:11.368 | 99.00th=[52691], 99.50th=[59507], 99.90th=[82314], 99.95th=[83362], 00:21:11.368 | 99.99th=[87557] 00:21:11.368 bw ( KiB/s): min=320512, max=1183425, per=12.26%, avg=615834.25, stdev=189460.52, samples=20 00:21:11.368 iops : min= 1252, max= 4622, avg=2405.55, stdev=739.94, samples=20 00:21:11.368 lat (usec) : 1000=0.01% 00:21:11.368 lat (msec) : 2=0.21%, 4=0.30%, 10=0.92%, 20=18.52%, 50=75.34% 00:21:11.368 lat (msec) : 100=4.71% 00:21:11.368 cpu : usr=0.39%, sys=4.54%, ctx=6160, majf=0, minf=4097 00:21:11.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:21:11.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.368 issued rwts: total=24120,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.368 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.368 job6: (groupid=0, jobs=1): err= 0: pid=683396: Wed Apr 24 15:22:13 2024 00:21:11.368 read: IOPS=2197, BW=549MiB/s (576MB/s)(5518MiB/10045msec) 00:21:11.368 slat (usec): min=11, max=35717, avg=441.09, stdev=1325.56 00:21:11.368 clat (usec): min=333, max=123053, avg=28656.78, stdev=19105.14 00:21:11.368 lat (usec): min=352, max=123073, avg=29097.88, stdev=19420.66 00:21:11.368 clat percentiles (msec): 00:21:11.368 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 13], 00:21:11.368 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 25], 60.00th=[ 26], 00:21:11.368 | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 65], 00:21:11.368 | 99.00th=[ 84], 99.50th=[ 89], 99.90th=[ 93], 99.95th=[ 99], 00:21:11.368 | 99.99th=[ 122] 00:21:11.368 bw ( KiB/s): min=198144, max=1276928, per=11.21%, avg=563346.50, stdev=361715.34, samples=20 00:21:11.368 iops : min= 774, max= 4988, avg=2200.55, stdev=1412.97, samples=20 00:21:11.368 lat (usec) : 500=0.06%, 750=0.15%, 1000=0.05% 00:21:11.368 lat (msec) : 2=0.30%, 4=0.82%, 10=1.08%, 20=40.16%, 50=37.43% 00:21:11.368 lat (msec) : 100=19.90%, 250=0.05% 00:21:11.368 cpu : usr=0.35%, sys=4.20%, ctx=5978, majf=0, minf=3533 00:21:11.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:21:11.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.368 issued rwts: total=22070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.368 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.368 job7: (groupid=0, jobs=1): err= 0: pid=683403: Wed Apr 24 15:22:13 2024 00:21:11.368 read: IOPS=1810, BW=453MiB/s (475MB/s)(4548MiB/10046msec) 00:21:11.368 slat (usec): min=11, max=18845, avg=528.65, stdev=1357.96 00:21:11.368 clat (msec): min=12, max=105, avg=34.77, stdev=14.88 00:21:11.368 lat (msec): min=12, max=105, avg=35.30, stdev=15.14 00:21:11.368 clat percentiles (msec): 00:21:11.368 | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 25], 20.00th=[ 26], 00:21:11.368 | 30.00th=[ 26], 40.00th=[ 26], 50.00th=[ 27], 60.00th=[ 28], 00:21:11.368 | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 55], 95.00th=[ 65], 00:21:11.368 | 99.00th=[ 87], 99.50th=[ 89], 99.90th=[ 94], 99.95th=[ 97], 00:21:11.368 | 99.99th=[ 106] 00:21:11.368 bw ( KiB/s): min=236544, max=638976, per=9.24%, avg=464066.60, stdev=163054.12, samples=20 00:21:11.368 iops : min= 924, max= 2496, avg=1812.75, stdev=636.94, samples=20 00:21:11.368 lat (msec) : 20=1.09%, 50=76.25%, 100=22.64%, 250=0.02% 00:21:11.368 cpu : usr=0.32%, sys=3.52%, ctx=5092, majf=0, minf=4097 00:21:11.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:11.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.368 issued rwts: total=18192,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.368 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.368 job8: (groupid=0, jobs=1): err= 0: pid=683423: Wed Apr 24 15:22:13 2024 00:21:11.368 read: IOPS=1399, BW=350MiB/s (367MB/s)(3514MiB/10044msec) 00:21:11.368 slat (usec): min=11, max=48143, avg=695.24, stdev=1829.03 00:21:11.368 clat (msec): min=8, max=135, avg=44.99, stdev=11.00 00:21:11.368 lat (msec): min=8, max=135, avg=45.69, stdev=11.24 00:21:11.368 clat percentiles (msec): 00:21:11.368 | 1.00th=[ 33], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 38], 00:21:11.368 | 30.00th=[ 39], 40.00th=[ 39], 50.00th=[ 40], 60.00th=[ 42], 00:21:11.368 | 70.00th=[ 51], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 65], 00:21:11.368 | 99.00th=[ 87], 99.50th=[ 88], 99.90th=[ 92], 99.95th=[ 104], 00:21:11.368 | 99.99th=[ 136] 00:21:11.368 bw ( KiB/s): min=249856, max=423936, per=7.13%, avg=358063.35, stdev=62738.97, samples=20 00:21:11.368 iops : min= 976, max= 1656, avg=1398.60, stdev=245.07, samples=20 00:21:11.368 lat (msec) : 10=0.08%, 20=0.31%, 50=69.88%, 100=29.66%, 250=0.08% 00:21:11.368 cpu : usr=0.28%, sys=3.37%, ctx=3606, majf=0, minf=4097 00:21:11.368 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:11.368 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.368 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.368 issued rwts: total=14054,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.369 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.369 job9: (groupid=0, jobs=1): err= 0: pid=683433: Wed Apr 24 15:22:13 2024 00:21:11.369 read: IOPS=2021, BW=505MiB/s (530MB/s)(5062MiB/10014msec) 00:21:11.369 slat (usec): min=11, max=12259, avg=474.53, stdev=1163.19 00:21:11.369 clat (usec): min=8607, max=74441, avg=31143.80, stdev=14456.62 00:21:11.369 lat (usec): min=8844, max=75311, avg=31618.33, stdev=14694.79 00:21:11.369 clat percentiles (usec): 00:21:11.369 | 1.00th=[11731], 5.00th=[12125], 10.00th=[12387], 20.00th=[12780], 00:21:11.369 | 30.00th=[21365], 40.00th=[25822], 50.00th=[36963], 60.00th=[38011], 00:21:11.369 | 70.00th=[38536], 80.00th=[41157], 90.00th=[50594], 95.00th=[52167], 00:21:11.369 | 99.00th=[63177], 99.50th=[63701], 99.90th=[67634], 99.95th=[70779], 00:21:11.369 | 99.99th=[72877] 00:21:11.369 bw ( KiB/s): min=266752, max=1226752, per=10.28%, avg=516757.80, stdev=269139.88, samples=20 00:21:11.369 iops : min= 1042, max= 4792, avg=2018.55, stdev=1051.35, samples=20 00:21:11.369 lat (msec) : 10=0.05%, 20=29.59%, 50=57.23%, 100=13.13% 00:21:11.369 cpu : usr=0.38%, sys=4.52%, ctx=5258, majf=0, minf=4097 00:21:11.369 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:11.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.369 issued rwts: total=20248,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.369 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.369 job10: (groupid=0, jobs=1): err= 0: pid=683438: Wed Apr 24 15:22:13 2024 00:21:11.369 read: IOPS=1641, BW=410MiB/s (430MB/s)(4113MiB/10020msec) 00:21:11.369 slat (usec): min=10, max=13458, avg=604.86, stdev=1391.99 00:21:11.369 clat (usec): min=10861, max=76170, avg=38333.82, stdev=9543.93 00:21:11.369 lat (usec): min=11233, max=76538, avg=38938.68, stdev=9734.33 00:21:11.369 clat percentiles (usec): 00:21:11.369 | 1.00th=[23725], 5.00th=[24773], 10.00th=[25297], 20.00th=[26608], 00:21:11.369 | 30.00th=[36439], 40.00th=[37487], 50.00th=[38011], 60.00th=[38536], 00:21:11.369 | 70.00th=[39584], 80.00th=[48497], 90.00th=[51119], 95.00th=[53740], 00:21:11.369 | 99.00th=[63701], 99.50th=[64750], 99.90th=[69731], 99.95th=[70779], 00:21:11.369 | 99.99th=[76022] 00:21:11.369 bw ( KiB/s): min=267776, max=627200, per=8.35%, avg=419352.00, stdev=97802.22, samples=20 00:21:11.369 iops : min= 1046, max= 2450, avg=1637.95, stdev=382.08, samples=20 00:21:11.369 lat (msec) : 20=0.30%, 50=83.08%, 100=16.62% 00:21:11.369 cpu : usr=0.26%, sys=3.46%, ctx=3982, majf=0, minf=4097 00:21:11.369 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:11.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:11.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:11.369 issued rwts: total=16450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:11.369 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:11.369 00:21:11.369 Run status group 0 (all jobs): 00:21:11.369 READ: bw=4907MiB/s (5146MB/s), 344MiB/s-601MiB/s (361MB/s-630MB/s), io=48.1GiB (51.7GB), run=10014-10046msec 00:21:11.369 00:21:11.369 Disk stats (read/write): 00:21:11.369 nvme0n1: ios=31056/0, merge=0/0, ticks=1219848/0, in_queue=1219848, util=97.19% 00:21:11.369 nvme10n1: ios=31742/0, merge=0/0, ticks=1219200/0, in_queue=1219200, util=97.44% 00:21:11.369 nvme1n1: ios=27435/0, merge=0/0, ticks=1221959/0, in_queue=1221959, util=97.70% 00:21:11.369 nvme2n1: ios=41714/0, merge=0/0, ticks=1214412/0, in_queue=1214412, util=97.86% 00:21:11.369 nvme3n1: ios=30671/0, merge=0/0, ticks=1217390/0, in_queue=1217390, util=97.94% 00:21:11.369 nvme4n1: ios=47935/0, merge=0/0, ticks=1216867/0, in_queue=1216867, util=98.26% 00:21:11.369 nvme5n1: ios=43896/0, merge=0/0, ticks=1216905/0, in_queue=1216905, util=98.42% 00:21:11.369 nvme6n1: ios=36140/0, merge=0/0, ticks=1215905/0, in_queue=1215905, util=98.52% 00:21:11.369 nvme7n1: ios=27870/0, merge=0/0, ticks=1218612/0, in_queue=1218612, util=98.87% 00:21:11.369 nvme8n1: ios=39798/0, merge=0/0, ticks=1221019/0, in_queue=1221019, util=99.05% 00:21:11.369 nvme9n1: ios=32482/0, merge=0/0, ticks=1217640/0, in_queue=1217640, util=99.16% 00:21:11.369 15:22:13 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:21:11.369 [global] 00:21:11.369 thread=1 00:21:11.369 invalidate=1 00:21:11.369 rw=randwrite 00:21:11.369 time_based=1 00:21:11.369 runtime=10 00:21:11.369 ioengine=libaio 00:21:11.369 direct=1 00:21:11.369 bs=262144 00:21:11.369 iodepth=64 00:21:11.369 norandommap=1 00:21:11.369 numjobs=1 00:21:11.369 00:21:11.369 [job0] 00:21:11.369 filename=/dev/nvme0n1 00:21:11.369 [job1] 00:21:11.369 filename=/dev/nvme10n1 00:21:11.369 [job2] 00:21:11.369 filename=/dev/nvme1n1 00:21:11.369 [job3] 00:21:11.369 filename=/dev/nvme2n1 00:21:11.369 [job4] 00:21:11.369 filename=/dev/nvme3n1 00:21:11.369 [job5] 00:21:11.369 filename=/dev/nvme4n1 00:21:11.369 [job6] 00:21:11.369 filename=/dev/nvme5n1 00:21:11.369 [job7] 00:21:11.369 filename=/dev/nvme6n1 00:21:11.369 [job8] 00:21:11.369 filename=/dev/nvme7n1 00:21:11.369 [job9] 00:21:11.369 filename=/dev/nvme8n1 00:21:11.369 [job10] 00:21:11.369 filename=/dev/nvme9n1 00:21:11.369 Could not set queue depth (nvme0n1) 00:21:11.369 Could not set queue depth (nvme10n1) 00:21:11.369 Could not set queue depth (nvme1n1) 00:21:11.369 Could not set queue depth (nvme2n1) 00:21:11.369 Could not set queue depth (nvme3n1) 00:21:11.369 Could not set queue depth (nvme4n1) 00:21:11.369 Could not set queue depth (nvme5n1) 00:21:11.369 Could not set queue depth (nvme6n1) 00:21:11.369 Could not set queue depth (nvme7n1) 00:21:11.369 Could not set queue depth (nvme8n1) 00:21:11.369 Could not set queue depth (nvme9n1) 00:21:11.369 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.369 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.369 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.369 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.369 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:11.370 fio-3.35 00:21:11.370 Starting 11 threads 00:21:21.353 00:21:21.354 job0: (groupid=0, jobs=1): err= 0: pid=684871: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1184, BW=296MiB/s (310MB/s)(2973MiB/10041msec); 0 zone resets 00:21:21.354 slat (usec): min=24, max=99582, avg=619.00, stdev=3200.94 00:21:21.354 clat (usec): min=252, max=236538, avg=53402.76, stdev=32830.77 00:21:21.354 lat (usec): min=313, max=236605, avg=54021.76, stdev=33331.83 00:21:21.354 clat percentiles (usec): 00:21:21.354 | 1.00th=[ 1172], 5.00th=[ 6194], 10.00th=[ 16319], 20.00th=[ 26870], 00:21:21.354 | 30.00th=[ 31851], 40.00th=[ 41157], 50.00th=[ 47449], 60.00th=[ 54264], 00:21:21.354 | 70.00th=[ 63701], 80.00th=[ 83362], 90.00th=[102237], 95.00th=[116917], 00:21:21.354 | 99.00th=[141558], 99.50th=[145753], 99.90th=[156238], 99.95th=[173016], 00:21:21.354 | 99.99th=[225444] 00:21:21.354 bw ( KiB/s): min=117248, max=556032, per=7.98%, avg=302761.40, stdev=112346.77, samples=20 00:21:21.354 iops : min= 458, max= 2172, avg=1182.65, stdev=438.85, samples=20 00:21:21.354 lat (usec) : 500=0.06%, 750=0.17%, 1000=0.31% 00:21:21.354 lat (msec) : 2=2.10%, 4=1.56%, 10=1.83%, 20=6.35%, 50=42.69% 00:21:21.354 lat (msec) : 100=33.71%, 250=11.23% 00:21:21.354 cpu : usr=2.77%, sys=4.37%, ctx=3299, majf=0, minf=16 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,11891,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job1: (groupid=0, jobs=1): err= 0: pid=684892: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1883, BW=471MiB/s (494MB/s)(4729MiB/10042msec); 0 zone resets 00:21:21.354 slat (usec): min=23, max=46977, avg=464.88, stdev=1658.29 00:21:21.354 clat (usec): min=528, max=143057, avg=33500.81, stdev=21954.01 00:21:21.354 lat (usec): min=773, max=157453, avg=33965.70, stdev=22286.01 00:21:21.354 clat percentiles (msec): 00:21:21.354 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 16], 00:21:21.354 | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 29], 60.00th=[ 34], 00:21:21.354 | 70.00th=[ 42], 80.00th=[ 48], 90.00th=[ 64], 95.00th=[ 80], 00:21:21.354 | 99.00th=[ 109], 99.50th=[ 118], 99.90th=[ 136], 99.95th=[ 140], 00:21:21.354 | 99.99th=[ 140] 00:21:21.354 bw ( KiB/s): min=138240, max=1052160, per=12.73%, avg=482662.40, stdev=261973.74, samples=20 00:21:21.354 iops : min= 540, max= 4110, avg=1885.40, stdev=1023.33, samples=20 00:21:21.354 lat (usec) : 750=0.01%, 1000=0.03% 00:21:21.354 lat (msec) : 2=0.15%, 4=0.74%, 10=1.99%, 20=34.96%, 50=44.93% 00:21:21.354 lat (msec) : 100=15.53%, 250=1.65% 00:21:21.354 cpu : usr=5.27%, sys=5.56%, ctx=3811, majf=0, minf=410 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,18917,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job2: (groupid=0, jobs=1): err= 0: pid=684899: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1236, BW=309MiB/s (324MB/s)(3098MiB/10019msec); 0 zone resets 00:21:21.354 slat (usec): min=18, max=92097, avg=603.50, stdev=3573.13 00:21:21.354 clat (usec): min=419, max=227939, avg=51117.73, stdev=32326.20 00:21:21.354 lat (usec): min=536, max=229570, avg=51721.23, stdev=32921.29 00:21:21.354 clat percentiles (usec): 00:21:21.354 | 1.00th=[ 914], 5.00th=[ 6521], 10.00th=[ 13304], 20.00th=[ 23200], 00:21:21.354 | 30.00th=[ 31589], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 52167], 00:21:21.354 | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[113771], 00:21:21.354 | 99.00th=[139461], 99.50th=[141558], 99.90th=[160433], 99.95th=[164627], 00:21:21.354 | 99.99th=[204473] 00:21:21.354 bw ( KiB/s): min=159232, max=536576, per=8.32%, avg=315627.60, stdev=99322.46, samples=20 00:21:21.354 iops : min= 622, max= 2096, avg=1232.90, stdev=388.00, samples=20 00:21:21.354 lat (usec) : 500=0.02%, 750=0.55%, 1000=0.57% 00:21:21.354 lat (msec) : 2=0.68%, 4=1.83%, 10=4.08%, 20=9.00%, 50=41.65% 00:21:21.354 lat (msec) : 100=32.38%, 250=9.23% 00:21:21.354 cpu : usr=2.97%, sys=4.44%, ctx=3423, majf=0, minf=16 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,12393,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job3: (groupid=0, jobs=1): err= 0: pid=684900: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1212, BW=303MiB/s (318MB/s)(3052MiB/10065msec); 0 zone resets 00:21:21.354 slat (usec): min=14, max=114846, avg=561.48, stdev=3236.23 00:21:21.354 clat (usec): min=338, max=248411, avg=52188.82, stdev=31725.54 00:21:21.354 lat (usec): min=414, max=248477, avg=52750.30, stdev=32262.48 00:21:21.354 clat percentiles (usec): 00:21:21.354 | 1.00th=[ 1106], 5.00th=[ 4228], 10.00th=[ 16712], 20.00th=[ 27657], 00:21:21.354 | 30.00th=[ 34341], 40.00th=[ 39584], 50.00th=[ 44303], 60.00th=[ 53216], 00:21:21.354 | 70.00th=[ 64750], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[109577], 00:21:21.354 | 99.00th=[141558], 99.50th=[147850], 99.90th=[168821], 99.95th=[202376], 00:21:21.354 | 99.99th=[248513] 00:21:21.354 bw ( KiB/s): min=126464, max=531968, per=8.20%, avg=310814.45, stdev=107196.04, samples=20 00:21:21.354 iops : min= 494, max= 2078, avg=1214.10, stdev=418.75, samples=20 00:21:21.354 lat (usec) : 500=0.04%, 750=0.24%, 1000=0.58% 00:21:21.354 lat (msec) : 2=2.15%, 4=1.92%, 10=2.05%, 20=5.25%, 50=45.19% 00:21:21.354 lat (msec) : 100=34.05%, 250=8.54% 00:21:21.354 cpu : usr=3.03%, sys=4.57%, ctx=3750, majf=0, minf=20 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,12206,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job4: (groupid=0, jobs=1): err= 0: pid=684901: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1481, BW=370MiB/s (388MB/s)(3724MiB/10057msec); 0 zone resets 00:21:21.354 slat (usec): min=14, max=87268, avg=442.42, stdev=2847.09 00:21:21.354 clat (usec): min=185, max=224952, avg=42752.51, stdev=36222.47 00:21:21.354 lat (usec): min=227, max=225021, avg=43194.93, stdev=36707.28 00:21:21.354 clat percentiles (usec): 00:21:21.354 | 1.00th=[ 693], 5.00th=[ 1729], 10.00th=[ 2933], 20.00th=[ 8717], 00:21:21.354 | 30.00th=[ 14877], 40.00th=[ 22414], 50.00th=[ 34866], 60.00th=[ 44827], 00:21:21.354 | 70.00th=[ 58983], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[108528], 00:21:21.354 | 99.00th=[139461], 99.50th=[139461], 99.90th=[154141], 99.95th=[198181], 00:21:21.354 | 99.99th=[225444] 00:21:21.354 bw ( KiB/s): min=124928, max=803328, per=10.01%, avg=379655.40, stdev=203079.55, samples=20 00:21:21.354 iops : min= 488, max= 3138, avg=1483.00, stdev=793.24, samples=20 00:21:21.354 lat (usec) : 250=0.05%, 500=0.23%, 750=1.08%, 1000=1.36% 00:21:21.354 lat (msec) : 2=3.45%, 4=6.56%, 10=10.13%, 20=14.86%, 50=26.92% 00:21:21.354 lat (msec) : 100=26.45%, 250=8.91% 00:21:21.354 cpu : usr=3.47%, sys=5.19%, ctx=4406, majf=0, minf=13 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,14897,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job5: (groupid=0, jobs=1): err= 0: pid=684902: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1320, BW=330MiB/s (346MB/s)(3320MiB/10057msec); 0 zone resets 00:21:21.354 slat (usec): min=15, max=83438, avg=475.93, stdev=2671.22 00:21:21.354 clat (usec): min=204, max=220743, avg=47986.34, stdev=31467.29 00:21:21.354 lat (usec): min=220, max=220818, avg=48462.26, stdev=31814.91 00:21:21.354 clat percentiles (usec): 00:21:21.354 | 1.00th=[ 1188], 5.00th=[ 7832], 10.00th=[ 14615], 20.00th=[ 20579], 00:21:21.354 | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 45876], 00:21:21.354 | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[109577], 00:21:21.354 | 99.00th=[139461], 99.50th=[141558], 99.90th=[145753], 99.95th=[145753], 00:21:21.354 | 99.99th=[221250] 00:21:21.354 bw ( KiB/s): min=101888, max=688640, per=8.92%, avg=338221.85, stdev=144483.68, samples=20 00:21:21.354 iops : min= 398, max= 2690, avg=1321.10, stdev=564.35, samples=20 00:21:21.354 lat (usec) : 250=0.02%, 500=0.21%, 750=0.32%, 1000=0.20% 00:21:21.354 lat (msec) : 2=1.28%, 4=1.33%, 10=3.10%, 20=12.68%, 50=46.31% 00:21:21.354 lat (msec) : 100=26.51%, 250=8.03% 00:21:21.354 cpu : usr=3.29%, sys=4.69%, ctx=3849, majf=0, minf=139 00:21:21.354 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:21.354 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.354 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.354 issued rwts: total=0,13278,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.354 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.354 job6: (groupid=0, jobs=1): err= 0: pid=684903: Wed Apr 24 15:22:24 2024 00:21:21.354 write: IOPS=1004, BW=251MiB/s (263MB/s)(2522MiB/10041msec); 0 zone resets 00:21:21.354 slat (usec): min=20, max=106378, avg=700.02, stdev=4170.44 00:21:21.354 clat (usec): min=523, max=228192, avg=62978.35, stdev=30471.95 00:21:21.354 lat (usec): min=608, max=243221, avg=63678.37, stdev=31160.24 00:21:21.354 clat percentiles (msec): 00:21:21.354 | 1.00th=[ 4], 5.00th=[ 23], 10.00th=[ 31], 20.00th=[ 39], 00:21:21.354 | 30.00th=[ 45], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 66], 00:21:21.354 | 70.00th=[ 80], 80.00th=[ 90], 90.00th=[ 106], 95.00th=[ 120], 00:21:21.354 | 99.00th=[ 140], 99.50th=[ 142], 99.90th=[ 153], 99.95th=[ 161], 00:21:21.354 | 99.99th=[ 171] 00:21:21.354 bw ( KiB/s): min=128512, max=381952, per=6.77%, avg=256625.90, stdev=73959.99, samples=20 00:21:21.354 iops : min= 502, max= 1492, avg=1002.40, stdev=288.98, samples=20 00:21:21.354 lat (usec) : 750=0.04%, 1000=0.07% 00:21:21.354 lat (msec) : 2=0.29%, 4=0.76%, 10=1.35%, 20=1.74%, 50=39.69% 00:21:21.354 lat (msec) : 100=43.16%, 250=12.90% 00:21:21.354 cpu : usr=2.39%, sys=3.95%, ctx=2944, majf=0, minf=6 00:21:21.355 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:21.355 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.355 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.355 issued rwts: total=0,10088,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.355 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.355 job7: (groupid=0, jobs=1): err= 0: pid=684904: Wed Apr 24 15:22:24 2024 00:21:21.355 write: IOPS=1923, BW=481MiB/s (504MB/s)(4826MiB/10036msec); 0 zone resets 00:21:21.355 slat (usec): min=15, max=116504, avg=348.47, stdev=2237.86 00:21:21.355 clat (usec): min=263, max=250341, avg=32914.58, stdev=27540.13 00:21:21.355 lat (usec): min=319, max=260113, avg=33263.05, stdev=27936.39 00:21:21.355 clat percentiles (usec): 00:21:21.355 | 1.00th=[ 857], 5.00th=[ 2073], 10.00th=[ 4113], 20.00th=[ 10290], 00:21:21.355 | 30.00th=[ 15008], 40.00th=[ 20055], 50.00th=[ 27919], 60.00th=[ 33817], 00:21:21.355 | 70.00th=[ 41681], 80.00th=[ 48497], 90.00th=[ 68682], 95.00th=[ 85459], 00:21:21.355 | 99.00th=[133694], 99.50th=[137364], 99.90th=[145753], 99.95th=[152044], 00:21:21.355 | 99.99th=[250610] 00:21:21.355 bw ( KiB/s): min=164023, max=949760, per=12.99%, avg=492578.75, stdev=201049.35, samples=20 00:21:21.355 iops : min= 640, max= 3710, avg=1924.10, stdev=785.41, samples=20 00:21:21.355 lat (usec) : 500=0.10%, 750=0.59%, 1000=0.71% 00:21:21.355 lat (msec) : 2=3.32%, 4=5.08%, 10=9.73%, 20=20.21%, 50=41.67% 00:21:21.355 lat (msec) : 100=14.88%, 250=3.69%, 500=0.01% 00:21:21.355 cpu : usr=4.13%, sys=7.14%, ctx=5207, majf=0, minf=74 00:21:21.355 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:21.355 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.355 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.355 issued rwts: total=0,19305,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.355 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.355 job8: (groupid=0, jobs=1): err= 0: pid=684905: Wed Apr 24 15:22:24 2024 00:21:21.355 write: IOPS=1253, BW=313MiB/s (329MB/s)(3154MiB/10065msec); 0 zone resets 00:21:21.355 slat (usec): min=12, max=87233, avg=595.67, stdev=3357.68 00:21:21.355 clat (usec): min=278, max=175874, avg=50447.91, stdev=35822.85 00:21:21.355 lat (usec): min=331, max=211175, avg=51043.58, stdev=36455.54 00:21:21.355 clat percentiles (usec): 00:21:21.355 | 1.00th=[ 873], 5.00th=[ 1696], 10.00th=[ 3523], 20.00th=[ 15008], 00:21:21.355 | 30.00th=[ 31851], 40.00th=[ 39060], 50.00th=[ 44303], 60.00th=[ 51643], 00:21:21.355 | 70.00th=[ 63701], 80.00th=[ 84411], 90.00th=[104334], 95.00th=[116917], 00:21:21.355 | 99.00th=[139461], 99.50th=[141558], 99.90th=[162530], 99.95th=[173016], 00:21:21.355 | 99.99th=[175113] 00:21:21.355 bw ( KiB/s): min=112128, max=769024, per=8.47%, avg=321272.80, stdev=157362.22, samples=20 00:21:21.355 iops : min= 438, max= 3004, avg=1254.95, stdev=614.70, samples=20 00:21:21.355 lat (usec) : 500=0.13%, 750=0.32%, 1000=1.09% 00:21:21.355 lat (msec) : 2=4.46%, 4=5.02%, 10=6.00%, 20=6.06%, 50=34.56% 00:21:21.355 lat (msec) : 100=30.04%, 250=12.33% 00:21:21.355 cpu : usr=2.92%, sys=4.60%, ctx=3647, majf=0, minf=79 00:21:21.355 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:21.355 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.355 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.355 issued rwts: total=0,12614,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.355 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.355 job9: (groupid=0, jobs=1): err= 0: pid=684906: Wed Apr 24 15:22:24 2024 00:21:21.355 write: IOPS=1030, BW=258MiB/s (270MB/s)(2593MiB/10064msec); 0 zone resets 00:21:21.355 slat (usec): min=21, max=111862, avg=776.89, stdev=3259.69 00:21:21.355 clat (usec): min=499, max=174505, avg=61305.41, stdev=30728.02 00:21:21.355 lat (usec): min=572, max=213027, avg=62082.31, stdev=31285.25 00:21:21.355 clat percentiles (msec): 00:21:21.355 | 1.00th=[ 3], 5.00th=[ 19], 10.00th=[ 29], 20.00th=[ 38], 00:21:21.355 | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 64], 00:21:21.355 | 70.00th=[ 75], 80.00th=[ 88], 90.00th=[ 105], 95.00th=[ 118], 00:21:21.355 | 99.00th=[ 142], 99.50th=[ 146], 99.90th=[ 157], 99.95th=[ 167], 00:21:21.355 | 99.99th=[ 176] 00:21:21.355 bw ( KiB/s): min=113152, max=417280, per=6.96%, avg=263843.80, stdev=84500.59, samples=20 00:21:21.355 iops : min= 442, max= 1630, avg=1030.60, stdev=330.01, samples=20 00:21:21.355 lat (usec) : 500=0.01%, 750=0.15%, 1000=0.06% 00:21:21.355 lat (msec) : 2=0.21%, 4=1.22%, 10=1.69%, 20=2.24%, 50=38.04% 00:21:21.355 lat (msec) : 100=43.70%, 250=12.68% 00:21:21.355 cpu : usr=2.64%, sys=4.01%, ctx=2776, majf=0, minf=207 00:21:21.355 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:21.355 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.355 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.355 issued rwts: total=0,10371,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.355 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.355 job10: (groupid=0, jobs=1): err= 0: pid=684907: Wed Apr 24 15:22:24 2024 00:21:21.355 write: IOPS=1304, BW=326MiB/s (342MB/s)(3279MiB/10051msec); 0 zone resets 00:21:21.355 slat (usec): min=20, max=87013, avg=579.61, stdev=3007.02 00:21:21.355 clat (usec): min=202, max=195428, avg=48445.57, stdev=34940.42 00:21:21.355 lat (usec): min=256, max=195477, avg=49025.18, stdev=35476.49 00:21:21.355 clat percentiles (usec): 00:21:21.355 | 1.00th=[ 938], 5.00th=[ 1745], 10.00th=[ 3490], 20.00th=[ 14484], 00:21:21.355 | 30.00th=[ 26608], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 52691], 00:21:21.355 | 70.00th=[ 64226], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[110625], 00:21:21.355 | 99.00th=[137364], 99.50th=[141558], 99.90th=[149947], 99.95th=[168821], 00:21:21.355 | 99.99th=[196084] 00:21:21.355 bw ( KiB/s): min=164864, max=755225, per=8.81%, avg=334055.65, stdev=153936.17, samples=20 00:21:21.355 iops : min= 644, max= 2950, avg=1304.90, stdev=601.30, samples=20 00:21:21.355 lat (usec) : 250=0.03%, 500=0.10%, 750=0.40%, 1000=0.87% 00:21:21.355 lat (msec) : 2=5.53%, 4=3.88%, 10=5.45%, 20=7.99%, 50=33.56% 00:21:21.355 lat (msec) : 100=32.59%, 250=9.60% 00:21:21.355 cpu : usr=3.13%, sys=4.56%, ctx=3731, majf=0, minf=9 00:21:21.355 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:21.355 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:21.355 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:21.355 issued rwts: total=0,13115,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:21.355 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:21.355 00:21:21.355 Run status group 0 (all jobs): 00:21:21.355 WRITE: bw=3703MiB/s (3883MB/s), 251MiB/s-481MiB/s (263MB/s-504MB/s), io=36.4GiB (39.1GB), run=10019-10065msec 00:21:21.355 00:21:21.355 Disk stats (read/write): 00:21:21.355 nvme0n1: ios=49/23384, merge=0/0, ticks=21/1222135, in_queue=1222156, util=96.31% 00:21:21.355 nvme10n1: ios=0/37443, merge=0/0, ticks=0/1215346, in_queue=1215346, util=96.54% 00:21:21.355 nvme1n1: ios=0/24141, merge=0/0, ticks=0/1223672, in_queue=1223672, util=96.90% 00:21:21.355 nvme2n1: ios=0/23787, merge=0/0, ticks=0/1223902, in_queue=1223902, util=97.11% 00:21:21.355 nvme3n1: ios=0/29320, merge=0/0, ticks=0/1222288, in_queue=1222288, util=97.13% 00:21:21.355 nvme4n1: ios=0/26054, merge=0/0, ticks=0/1227999, in_queue=1227999, util=97.56% 00:21:21.355 nvme5n1: ios=0/19751, merge=0/0, ticks=0/1225588, in_queue=1225588, util=97.85% 00:21:21.355 nvme6n1: ios=0/37876, merge=0/0, ticks=0/1228627, in_queue=1228627, util=98.08% 00:21:21.355 nvme7n1: ios=0/24743, merge=0/0, ticks=0/1222278, in_queue=1222278, util=98.54% 00:21:21.355 nvme8n1: ios=0/20248, merge=0/0, ticks=0/1222123, in_queue=1222123, util=98.80% 00:21:21.355 nvme9n1: ios=0/25710, merge=0/0, ticks=0/1220105, in_queue=1220105, util=98.96% 00:21:21.355 15:22:24 -- target/multiconnection.sh@36 -- # sync 00:21:21.355 15:22:24 -- target/multiconnection.sh@37 -- # seq 1 11 00:21:21.355 15:22:24 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:21.355 15:22:24 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:21.614 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:21.614 15:22:25 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:21:21.614 15:22:25 -- common/autotest_common.sh@1205 -- # local i=0 00:21:21.614 15:22:25 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:21.614 15:22:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:21:21.614 15:22:25 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK1 00:21:21.614 15:22:25 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:21.614 15:22:25 -- common/autotest_common.sh@1217 -- # return 0 00:21:21.614 15:22:25 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:21.614 15:22:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:21.614 15:22:25 -- common/autotest_common.sh@10 -- # set +x 00:21:21.614 15:22:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:21.614 15:22:25 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:21.614 15:22:25 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:21:22.552 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:21:22.552 15:22:26 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:21:22.552 15:22:26 -- common/autotest_common.sh@1205 -- # local i=0 00:21:22.552 15:22:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:22.552 15:22:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:21:22.552 15:22:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:22.552 15:22:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK2 00:21:22.552 15:22:26 -- common/autotest_common.sh@1217 -- # return 0 00:21:22.552 15:22:26 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:22.552 15:22:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:22.552 15:22:26 -- common/autotest_common.sh@10 -- # set +x 00:21:22.552 15:22:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:22.552 15:22:26 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:22.552 15:22:26 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:21:23.489 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:21:23.489 15:22:27 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:21:23.489 15:22:27 -- common/autotest_common.sh@1205 -- # local i=0 00:21:23.489 15:22:27 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:23.489 15:22:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:21:23.489 15:22:27 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK3 00:21:23.489 15:22:27 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:23.489 15:22:27 -- common/autotest_common.sh@1217 -- # return 0 00:21:23.489 15:22:27 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:21:23.489 15:22:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.489 15:22:27 -- common/autotest_common.sh@10 -- # set +x 00:21:23.489 15:22:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.489 15:22:27 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:23.489 15:22:27 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:21:24.428 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:21:24.428 15:22:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:21:24.428 15:22:28 -- common/autotest_common.sh@1205 -- # local i=0 00:21:24.428 15:22:28 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:24.428 15:22:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:21:24.428 15:22:28 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:24.428 15:22:28 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK4 00:21:24.428 15:22:28 -- common/autotest_common.sh@1217 -- # return 0 00:21:24.428 15:22:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:21:24.428 15:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:24.428 15:22:28 -- common/autotest_common.sh@10 -- # set +x 00:21:24.428 15:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:24.428 15:22:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:24.428 15:22:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:21:25.366 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:21:25.367 15:22:28 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:21:25.367 15:22:28 -- common/autotest_common.sh@1205 -- # local i=0 00:21:25.367 15:22:28 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:25.367 15:22:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:21:25.367 15:22:28 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:25.367 15:22:28 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK5 00:21:25.367 15:22:28 -- common/autotest_common.sh@1217 -- # return 0 00:21:25.367 15:22:28 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:21:25.367 15:22:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:25.367 15:22:28 -- common/autotest_common.sh@10 -- # set +x 00:21:25.367 15:22:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:25.367 15:22:28 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:25.367 15:22:28 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:21:26.304 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:21:26.304 15:22:29 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:21:26.305 15:22:29 -- common/autotest_common.sh@1205 -- # local i=0 00:21:26.305 15:22:29 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:26.305 15:22:29 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:21:26.305 15:22:29 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK6 00:21:26.305 15:22:29 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:26.305 15:22:29 -- common/autotest_common.sh@1217 -- # return 0 00:21:26.305 15:22:29 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:21:26.305 15:22:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:26.305 15:22:29 -- common/autotest_common.sh@10 -- # set +x 00:21:26.305 15:22:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:26.305 15:22:29 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:26.305 15:22:29 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:21:26.873 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:21:26.873 15:22:30 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:21:26.873 15:22:30 -- common/autotest_common.sh@1205 -- # local i=0 00:21:26.873 15:22:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:26.873 15:22:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:21:27.132 15:22:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:27.132 15:22:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK7 00:21:27.132 15:22:30 -- common/autotest_common.sh@1217 -- # return 0 00:21:27.132 15:22:30 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:21:27.132 15:22:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:27.132 15:22:30 -- common/autotest_common.sh@10 -- # set +x 00:21:27.132 15:22:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:27.132 15:22:30 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:27.132 15:22:30 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:21:28.072 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:21:28.072 15:22:31 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:21:28.072 15:22:31 -- common/autotest_common.sh@1205 -- # local i=0 00:21:28.072 15:22:31 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:28.072 15:22:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:21:28.072 15:22:31 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:28.072 15:22:31 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK8 00:21:28.072 15:22:31 -- common/autotest_common.sh@1217 -- # return 0 00:21:28.072 15:22:31 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:21:28.072 15:22:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.072 15:22:31 -- common/autotest_common.sh@10 -- # set +x 00:21:28.072 15:22:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.072 15:22:31 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:28.072 15:22:31 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:21:29.008 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:21:29.008 15:22:32 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:21:29.008 15:22:32 -- common/autotest_common.sh@1205 -- # local i=0 00:21:29.008 15:22:32 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:29.008 15:22:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:21:29.008 15:22:32 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:29.008 15:22:32 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK9 00:21:29.008 15:22:32 -- common/autotest_common.sh@1217 -- # return 0 00:21:29.008 15:22:32 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:21:29.008 15:22:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:29.008 15:22:32 -- common/autotest_common.sh@10 -- # set +x 00:21:29.008 15:22:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:29.008 15:22:32 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:29.008 15:22:32 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:21:29.943 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:21:29.943 15:22:33 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:21:29.944 15:22:33 -- common/autotest_common.sh@1205 -- # local i=0 00:21:29.944 15:22:33 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:29.944 15:22:33 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:21:29.944 15:22:33 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:29.944 15:22:33 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK10 00:21:29.944 15:22:33 -- common/autotest_common.sh@1217 -- # return 0 00:21:29.944 15:22:33 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:21:29.944 15:22:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:29.944 15:22:33 -- common/autotest_common.sh@10 -- # set +x 00:21:29.944 15:22:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:29.944 15:22:33 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:29.944 15:22:33 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:21:30.513 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:21:30.513 15:22:34 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:21:30.513 15:22:34 -- common/autotest_common.sh@1205 -- # local i=0 00:21:30.513 15:22:34 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:30.799 15:22:34 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:21:30.799 15:22:34 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:30.799 15:22:34 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK11 00:21:30.799 15:22:34 -- common/autotest_common.sh@1217 -- # return 0 00:21:30.799 15:22:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:21:30.799 15:22:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:30.799 15:22:34 -- common/autotest_common.sh@10 -- # set +x 00:21:30.799 15:22:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:30.799 15:22:34 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:21:30.799 15:22:34 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:21:30.799 15:22:34 -- target/multiconnection.sh@47 -- # nvmftestfini 00:21:30.799 15:22:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:30.799 15:22:34 -- nvmf/common.sh@117 -- # sync 00:21:30.799 15:22:34 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:30.799 15:22:34 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:30.799 15:22:34 -- nvmf/common.sh@120 -- # set +e 00:21:30.799 15:22:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:30.799 15:22:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:30.799 rmmod nvme_rdma 00:21:30.799 rmmod nvme_fabrics 00:21:30.799 15:22:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:30.799 15:22:34 -- nvmf/common.sh@124 -- # set -e 00:21:30.799 15:22:34 -- nvmf/common.sh@125 -- # return 0 00:21:30.799 15:22:34 -- nvmf/common.sh@478 -- # '[' -n 679537 ']' 00:21:30.799 15:22:34 -- nvmf/common.sh@479 -- # killprocess 679537 00:21:30.799 15:22:34 -- common/autotest_common.sh@936 -- # '[' -z 679537 ']' 00:21:30.799 15:22:34 -- common/autotest_common.sh@940 -- # kill -0 679537 00:21:30.799 15:22:34 -- common/autotest_common.sh@941 -- # uname 00:21:30.799 15:22:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.799 15:22:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 679537 00:21:30.799 15:22:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:30.799 15:22:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:30.799 15:22:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 679537' 00:21:30.799 killing process with pid 679537 00:21:30.799 15:22:34 -- common/autotest_common.sh@955 -- # kill 679537 00:21:30.799 15:22:34 -- common/autotest_common.sh@960 -- # wait 679537 00:21:30.799 [2024-04-24 15:22:34.611451] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:31.403 15:22:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:31.403 15:22:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:31.403 00:21:31.403 real 1m6.115s 00:21:31.403 user 4m5.821s 00:21:31.403 sys 0m18.721s 00:21:31.403 15:22:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:31.403 15:22:35 -- common/autotest_common.sh@10 -- # set +x 00:21:31.403 ************************************ 00:21:31.403 END TEST nvmf_multiconnection 00:21:31.403 ************************************ 00:21:31.403 15:22:35 -- nvmf/nvmf.sh@67 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:31.403 15:22:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:31.403 15:22:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:31.403 15:22:35 -- common/autotest_common.sh@10 -- # set +x 00:21:31.703 ************************************ 00:21:31.704 START TEST nvmf_initiator_timeout 00:21:31.704 ************************************ 00:21:31.704 15:22:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:31.704 * Looking for test storage... 00:21:31.704 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:21:31.704 15:22:35 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:21:31.704 15:22:35 -- nvmf/common.sh@7 -- # uname -s 00:21:31.704 15:22:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:31.704 15:22:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:31.704 15:22:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:31.704 15:22:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:31.704 15:22:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:31.704 15:22:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:31.704 15:22:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:31.704 15:22:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:31.704 15:22:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:31.704 15:22:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:31.704 15:22:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:21:31.704 15:22:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:21:31.704 15:22:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:31.704 15:22:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:31.704 15:22:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:31.704 15:22:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:31.704 15:22:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:21:31.704 15:22:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:31.704 15:22:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:31.704 15:22:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:31.704 15:22:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.704 15:22:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.704 15:22:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.704 15:22:35 -- paths/export.sh@5 -- # export PATH 00:21:31.704 15:22:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.704 15:22:35 -- nvmf/common.sh@47 -- # : 0 00:21:31.704 15:22:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:31.704 15:22:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:31.704 15:22:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:31.704 15:22:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:31.704 15:22:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:31.704 15:22:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:31.704 15:22:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:31.704 15:22:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:31.704 15:22:35 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:31.704 15:22:35 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:31.704 15:22:35 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:21:31.704 15:22:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:31.704 15:22:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:31.704 15:22:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:31.704 15:22:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:31.704 15:22:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:31.704 15:22:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:31.704 15:22:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:31.704 15:22:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:31.704 15:22:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:31.704 15:22:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:31.704 15:22:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:31.704 15:22:35 -- common/autotest_common.sh@10 -- # set +x 00:21:39.837 15:22:42 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.837 15:22:42 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:39.837 15:22:42 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:39.837 15:22:42 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:39.837 15:22:42 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:39.837 15:22:42 -- nvmf/common.sh@295 -- # net_devs=() 00:21:39.837 15:22:42 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@296 -- # e810=() 00:21:39.837 15:22:42 -- nvmf/common.sh@296 -- # local -ga e810 00:21:39.837 15:22:42 -- nvmf/common.sh@297 -- # x722=() 00:21:39.837 15:22:42 -- nvmf/common.sh@297 -- # local -ga x722 00:21:39.837 15:22:42 -- nvmf/common.sh@298 -- # mlx=() 00:21:39.837 15:22:42 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:39.837 15:22:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.837 15:22:42 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:21:39.837 Found 0000:18:00.0 (0x8086 - 0x1592) 00:21:39.837 15:22:42 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:39.837 15:22:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:21:39.837 Found 0000:18:00.1 (0x8086 - 0x1592) 00:21:39.837 15:22:42 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:39.837 15:22:42 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@377 -- # modinfo irdma 00:21:39.837 15:22:42 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:21:39.837 15:22:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.837 15:22:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.837 15:22:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:21:39.837 Found net devices under 0000:18:00.0: cvl_0_0 00:21:39.837 15:22:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.837 15:22:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.837 15:22:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:21:39.837 Found net devices under 0000:18:00.1: cvl_0_1 00:21:39.837 15:22:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.837 15:22:42 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:39.837 15:22:42 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:39.837 15:22:42 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:39.837 15:22:42 -- nvmf/common.sh@58 -- # uname 00:21:39.837 15:22:42 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:39.837 15:22:42 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:39.837 15:22:42 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:39.837 15:22:42 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:39.837 15:22:42 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:39.837 15:22:42 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:39.837 15:22:42 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:39.837 15:22:42 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:39.837 15:22:42 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:39.837 15:22:42 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:39.837 15:22:42 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:39.837 15:22:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:39.837 15:22:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:39.837 15:22:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:39.837 15:22:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:21:39.837 15:22:42 -- nvmf/common.sh@105 -- # continue 2 00:21:39.837 15:22:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.837 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:21:39.837 15:22:42 -- nvmf/common.sh@105 -- # continue 2 00:21:39.837 15:22:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:39.837 15:22:42 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:21:39.837 15:22:42 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:39.837 15:22:42 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:39.837 15:22:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:21:39.837 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:21:39.837 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:21:39.837 altname enp24s0f0np0 00:21:39.837 altname ens785f0np0 00:21:39.837 inet 192.168.100.8/24 scope global cvl_0_0 00:21:39.837 valid_lft forever preferred_lft forever 00:21:39.837 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:21:39.837 valid_lft forever preferred_lft forever 00:21:39.837 15:22:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:39.837 15:22:42 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:21:39.837 15:22:42 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:39.837 15:22:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:39.837 15:22:42 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:39.837 15:22:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:21:39.837 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:21:39.837 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:21:39.837 altname enp24s0f1np1 00:21:39.837 altname ens785f1np1 00:21:39.837 inet 192.168.100.9/24 scope global cvl_0_1 00:21:39.837 valid_lft forever preferred_lft forever 00:21:39.837 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:21:39.837 valid_lft forever preferred_lft forever 00:21:39.837 15:22:42 -- nvmf/common.sh@411 -- # return 0 00:21:39.837 15:22:42 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:39.837 15:22:42 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:39.837 15:22:42 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:39.837 15:22:42 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:39.837 15:22:42 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:39.837 15:22:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:39.837 15:22:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:39.838 15:22:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:39.838 15:22:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:39.838 15:22:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:39.838 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.838 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:21:39.838 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.838 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:21:39.838 15:22:42 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:21:39.838 15:22:42 -- nvmf/common.sh@105 -- # continue 2 00:21:39.838 15:22:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:39.838 15:22:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:39.838 15:22:42 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:21:39.838 15:22:42 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:21:39.838 15:22:42 -- nvmf/common.sh@105 -- # continue 2 00:21:39.838 15:22:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:39.838 15:22:42 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:21:39.838 15:22:42 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:39.838 15:22:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:39.838 15:22:42 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:21:39.838 15:22:42 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:39.838 15:22:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:21:39.838 15:22:42 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:39.838 192.168.100.9' 00:21:39.838 15:22:42 -- nvmf/common.sh@446 -- # head -n 1 00:21:39.838 15:22:42 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:39.838 192.168.100.9' 00:21:39.838 15:22:42 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:39.838 15:22:42 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:39.838 192.168.100.9' 00:21:39.838 15:22:42 -- nvmf/common.sh@447 -- # tail -n +2 00:21:39.838 15:22:42 -- nvmf/common.sh@447 -- # head -n 1 00:21:39.838 15:22:42 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:39.838 15:22:42 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:39.838 15:22:42 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:39.838 15:22:42 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:39.838 15:22:42 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:39.838 15:22:42 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:39.838 15:22:42 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:21:39.838 15:22:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:39.838 15:22:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:39.838 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 15:22:42 -- nvmf/common.sh@470 -- # nvmfpid=690782 00:21:39.838 15:22:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:39.838 15:22:42 -- nvmf/common.sh@471 -- # waitforlisten 690782 00:21:39.838 15:22:42 -- common/autotest_common.sh@817 -- # '[' -z 690782 ']' 00:21:39.838 15:22:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.838 15:22:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:39.838 15:22:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.838 15:22:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:39.838 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 [2024-04-24 15:22:42.527154] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:21:39.838 [2024-04-24 15:22:42.527210] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:39.838 EAL: No free 2048 kB hugepages reported on node 1 00:21:39.838 [2024-04-24 15:22:42.609537] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:39.838 [2024-04-24 15:22:42.692471] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:39.838 [2024-04-24 15:22:42.692520] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:39.838 [2024-04-24 15:22:42.692529] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:39.838 [2024-04-24 15:22:42.692537] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:39.838 [2024-04-24 15:22:42.692543] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:39.838 [2024-04-24 15:22:42.692640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:39.838 [2024-04-24 15:22:42.692724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.838 [2024-04-24 15:22:42.692821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:39.838 [2024-04-24 15:22:42.692823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:39.838 15:22:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:39.838 15:22:43 -- common/autotest_common.sh@850 -- # return 0 00:21:39.838 15:22:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:39.838 15:22:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 15:22:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 Malloc0 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 Delay0 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 [2024-04-24 15:22:43.443684] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xc45600/0xc44c40) succeed. 00:21:39.838 [2024-04-24 15:22:43.454331] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xc469b0/0xc451c0) succeed. 00:21:39.838 [2024-04-24 15:22:43.454355] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:39.838 15:22:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.838 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:21:39.838 [2024-04-24 15:22:43.486657] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:39.838 15:22:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:21:39.838 15:22:43 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:21:39.838 15:22:43 -- common/autotest_common.sh@1184 -- # local i=0 00:21:39.838 15:22:43 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:39.838 15:22:43 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:39.838 15:22:43 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:42.370 15:22:45 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:42.370 15:22:45 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:42.370 15:22:45 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:21:42.370 15:22:45 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:42.370 15:22:45 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:42.370 15:22:45 -- common/autotest_common.sh@1194 -- # return 0 00:21:42.370 15:22:45 -- target/initiator_timeout.sh@35 -- # fio_pid=691188 00:21:42.370 15:22:45 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:21:42.370 15:22:45 -- target/initiator_timeout.sh@37 -- # sleep 3 00:21:42.370 [global] 00:21:42.370 thread=1 00:21:42.370 invalidate=1 00:21:42.370 rw=write 00:21:42.370 time_based=1 00:21:42.370 runtime=60 00:21:42.370 ioengine=libaio 00:21:42.370 direct=1 00:21:42.370 bs=4096 00:21:42.370 iodepth=1 00:21:42.370 norandommap=0 00:21:42.370 numjobs=1 00:21:42.370 00:21:42.370 verify_dump=1 00:21:42.370 verify_backlog=512 00:21:42.371 verify_state_save=0 00:21:42.371 do_verify=1 00:21:42.371 verify=crc32c-intel 00:21:42.371 [job0] 00:21:42.371 filename=/dev/nvme0n1 00:21:42.371 Could not set queue depth (nvme0n1) 00:21:42.371 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:21:42.371 fio-3.35 00:21:42.371 Starting 1 thread 00:21:44.905 15:22:48 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:21:44.905 15:22:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:44.905 15:22:48 -- common/autotest_common.sh@10 -- # set +x 00:21:44.905 true 00:21:44.905 15:22:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:44.905 15:22:48 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:21:44.905 15:22:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:44.905 15:22:48 -- common/autotest_common.sh@10 -- # set +x 00:21:44.905 true 00:21:44.905 15:22:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:44.905 15:22:48 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:21:44.905 15:22:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:44.905 15:22:48 -- common/autotest_common.sh@10 -- # set +x 00:21:44.905 true 00:21:44.905 15:22:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:44.905 15:22:48 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:21:44.905 15:22:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:44.905 15:22:48 -- common/autotest_common.sh@10 -- # set +x 00:21:44.905 true 00:21:44.905 15:22:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:44.905 15:22:48 -- target/initiator_timeout.sh@45 -- # sleep 3 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:21:48.194 15:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.194 15:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:48.194 true 00:21:48.194 15:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:21:48.194 15:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.194 15:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:48.194 true 00:21:48.194 15:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:21:48.194 15:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.194 15:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:48.194 true 00:21:48.194 15:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:21:48.194 15:22:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.194 15:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:48.194 true 00:21:48.194 15:22:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:21:48.194 15:22:51 -- target/initiator_timeout.sh@54 -- # wait 691188 00:22:44.436 00:22:44.436 job0: (groupid=0, jobs=1): err= 0: pid=691427: Wed Apr 24 15:23:46 2024 00:22:44.436 read: IOPS=1261, BW=5045KiB/s (5166kB/s)(296MiB/60000msec) 00:22:44.436 slat (nsec): min=3347, max=44561, avg=9260.11, stdev=1703.12 00:22:44.436 clat (usec): min=78, max=948, avg=107.85, stdev= 6.33 00:22:44.436 lat (usec): min=93, max=957, avg=117.11, stdev= 6.83 00:22:44.436 clat percentiles (usec): 00:22:44.436 | 1.00th=[ 97], 5.00th=[ 100], 10.00th=[ 101], 20.00th=[ 103], 00:22:44.436 | 30.00th=[ 105], 40.00th=[ 106], 50.00th=[ 109], 60.00th=[ 110], 00:22:44.436 | 70.00th=[ 111], 80.00th=[ 113], 90.00th=[ 116], 95.00th=[ 118], 00:22:44.436 | 99.00th=[ 122], 99.50th=[ 124], 99.90th=[ 130], 99.95th=[ 137], 00:22:44.436 | 99.99th=[ 186] 00:22:44.436 write: IOPS=1262, BW=5052KiB/s (5173kB/s)(296MiB/60000msec); 0 zone resets 00:22:44.436 slat (usec): min=4, max=12506, avg=11.97, stdev=53.69 00:22:44.436 clat (usec): min=80, max=41923k, avg=658.74, stdev=152295.49 00:22:44.436 lat (usec): min=92, max=41923k, avg=670.71, stdev=152295.50 00:22:44.436 clat percentiles (usec): 00:22:44.436 | 1.00th=[ 94], 5.00th=[ 97], 10.00th=[ 99], 20.00th=[ 101], 00:22:44.436 | 30.00th=[ 102], 40.00th=[ 104], 50.00th=[ 105], 60.00th=[ 108], 00:22:44.436 | 70.00th=[ 109], 80.00th=[ 111], 90.00th=[ 114], 95.00th=[ 116], 00:22:44.436 | 99.00th=[ 120], 99.50th=[ 122], 99.90th=[ 130], 99.95th=[ 137], 00:22:44.436 | 99.99th=[ 180] 00:22:44.436 bw ( KiB/s): min= 4248, max=17824, per=100.00%, avg=16384.00, stdev=2128.77, samples=36 00:22:44.436 iops : min= 1062, max= 4456, avg=4096.00, stdev=532.19, samples=36 00:22:44.436 lat (usec) : 100=11.02%, 250=88.98%, 500=0.01%, 1000=0.01% 00:22:44.436 lat (msec) : 2=0.01%, >=2000=0.01% 00:22:44.436 cpu : usr=1.49%, sys=2.72%, ctx=151460, majf=0, minf=107 00:22:44.436 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:22:44.436 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.436 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:44.436 issued rwts: total=75672,75776,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:44.436 latency : target=0, window=0, percentile=100.00%, depth=1 00:22:44.436 00:22:44.436 Run status group 0 (all jobs): 00:22:44.436 READ: bw=5045KiB/s (5166kB/s), 5045KiB/s-5045KiB/s (5166kB/s-5166kB/s), io=296MiB (310MB), run=60000-60000msec 00:22:44.436 WRITE: bw=5052KiB/s (5173kB/s), 5052KiB/s-5052KiB/s (5173kB/s-5173kB/s), io=296MiB (310MB), run=60000-60000msec 00:22:44.436 00:22:44.436 Disk stats (read/write): 00:22:44.436 nvme0n1: ios=75538/75264, merge=0/0, ticks=7744/7348, in_queue=15092, util=99.67% 00:22:44.436 15:23:46 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:44.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:22:44.436 15:23:47 -- common/autotest_common.sh@1205 -- # local i=0 00:22:44.436 15:23:47 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:22:44.436 15:23:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:44.436 15:23:47 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:22:44.436 15:23:47 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:22:44.436 15:23:47 -- common/autotest_common.sh@1217 -- # return 0 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:22:44.436 nvmf hotplug test: fio successful as expected 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:44.436 15:23:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:44.436 15:23:47 -- common/autotest_common.sh@10 -- # set +x 00:22:44.436 15:23:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:22:44.436 15:23:47 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:22:44.436 15:23:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:44.436 15:23:47 -- nvmf/common.sh@117 -- # sync 00:22:44.436 15:23:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:44.436 15:23:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:44.436 15:23:47 -- nvmf/common.sh@120 -- # set +e 00:22:44.436 15:23:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:44.436 15:23:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:44.436 rmmod nvme_rdma 00:22:44.436 rmmod nvme_fabrics 00:22:44.436 15:23:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:44.436 15:23:47 -- nvmf/common.sh@124 -- # set -e 00:22:44.436 15:23:47 -- nvmf/common.sh@125 -- # return 0 00:22:44.436 15:23:47 -- nvmf/common.sh@478 -- # '[' -n 690782 ']' 00:22:44.436 15:23:47 -- nvmf/common.sh@479 -- # killprocess 690782 00:22:44.436 15:23:47 -- common/autotest_common.sh@936 -- # '[' -z 690782 ']' 00:22:44.436 15:23:47 -- common/autotest_common.sh@940 -- # kill -0 690782 00:22:44.436 15:23:47 -- common/autotest_common.sh@941 -- # uname 00:22:44.436 15:23:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:44.436 15:23:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 690782 00:22:44.436 15:23:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:44.436 15:23:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:44.436 15:23:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 690782' 00:22:44.436 killing process with pid 690782 00:22:44.436 15:23:47 -- common/autotest_common.sh@955 -- # kill 690782 00:22:44.436 15:23:47 -- common/autotest_common.sh@960 -- # wait 690782 00:22:44.436 [2024-04-24 15:23:47.263763] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:44.436 15:23:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:44.436 15:23:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:44.436 00:22:44.436 real 1m12.179s 00:22:44.436 user 4m23.937s 00:22:44.436 sys 0m7.866s 00:22:44.436 15:23:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:44.436 15:23:47 -- common/autotest_common.sh@10 -- # set +x 00:22:44.436 ************************************ 00:22:44.436 END TEST nvmf_initiator_timeout 00:22:44.436 ************************************ 00:22:44.436 15:23:47 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:22:44.436 15:23:47 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:22:44.436 15:23:47 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:22:44.436 15:23:47 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:22:44.436 15:23:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:44.436 15:23:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:44.436 15:23:47 -- common/autotest_common.sh@10 -- # set +x 00:22:44.436 ************************************ 00:22:44.436 START TEST nvmf_device_removal 00:22:44.436 ************************************ 00:22:44.436 15:23:47 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:22:44.436 * Looking for test storage... 00:22:44.436 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.436 15:23:47 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/autotest_common.sh 00:22:44.436 15:23:47 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:22:44.436 15:23:47 -- common/autotest_common.sh@34 -- # set -e 00:22:44.436 15:23:47 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:22:44.436 15:23:47 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:22:44.436 15:23:47 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output ']' 00:22:44.436 15:23:47 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh ]] 00:22:44.436 15:23:47 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/build_config.sh 00:22:44.436 15:23:47 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:22:44.436 15:23:47 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:22:44.436 15:23:47 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:22:44.436 15:23:47 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:22:44.436 15:23:47 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:22:44.436 15:23:47 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:22:44.436 15:23:47 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:22:44.436 15:23:47 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:22:44.436 15:23:47 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:22:44.436 15:23:47 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:22:44.436 15:23:47 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:22:44.436 15:23:47 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:22:44.436 15:23:47 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:22:44.436 15:23:47 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:22:44.436 15:23:47 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:22:44.436 15:23:47 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:22:44.436 15:23:47 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:22:44.436 15:23:47 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:22:44.436 15:23:47 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:22:44.436 15:23:47 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:22:44.436 15:23:47 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:22:44.436 15:23:47 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:22:44.436 15:23:47 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:22:44.436 15:23:47 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:22:44.436 15:23:47 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:22:44.436 15:23:47 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:22:44.436 15:23:47 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:22:44.436 15:23:47 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:22:44.436 15:23:47 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:22:44.436 15:23:47 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:22:44.436 15:23:47 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:22:44.436 15:23:47 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:22:44.436 15:23:47 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:22:44.436 15:23:47 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:22:44.436 15:23:47 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:22:44.436 15:23:47 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:22:44.436 15:23:47 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:22:44.436 15:23:47 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:22:44.436 15:23:47 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:22:44.436 15:23:47 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:22:44.436 15:23:47 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:22:44.436 15:23:47 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:22:44.436 15:23:47 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:22:44.436 15:23:47 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:22:44.436 15:23:47 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:22:44.436 15:23:47 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:22:44.436 15:23:47 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:22:44.436 15:23:47 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:22:44.436 15:23:47 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:22:44.436 15:23:47 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:22:44.436 15:23:47 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:22:44.436 15:23:47 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:22:44.436 15:23:47 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:22:44.436 15:23:47 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:22:44.436 15:23:47 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:22:44.436 15:23:47 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:22:44.436 15:23:47 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:22:44.436 15:23:47 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:22:44.436 15:23:47 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:22:44.436 15:23:47 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:22:44.436 15:23:47 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:22:44.436 15:23:47 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:22:44.436 15:23:47 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:22:44.436 15:23:47 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:22:44.436 15:23:47 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:22:44.436 15:23:47 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:22:44.436 15:23:47 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:22:44.436 15:23:47 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:22:44.436 15:23:47 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:22:44.436 15:23:47 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:22:44.436 15:23:47 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:22:44.436 15:23:47 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:22:44.436 15:23:47 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:22:44.436 15:23:47 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:22:44.436 15:23:47 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:22:44.436 15:23:47 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:22:44.436 15:23:47 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common/applications.sh 00:22:44.436 15:23:47 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:22:44.436 15:23:47 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/common 00:22:44.436 15:23:47 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:22:44.436 15:23:47 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:22:44.436 15:23:47 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app 00:22:44.436 15:23:47 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:22:44.436 15:23:47 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:22:44.436 15:23:47 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:22:44.436 15:23:47 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:22:44.436 15:23:47 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:22:44.436 15:23:47 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:22:44.436 15:23:47 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:22:44.436 15:23:47 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/include/spdk/config.h ]] 00:22:44.436 15:23:47 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:22:44.436 #define SPDK_CONFIG_H 00:22:44.436 #define SPDK_CONFIG_APPS 1 00:22:44.436 #define SPDK_CONFIG_ARCH native 00:22:44.436 #undef SPDK_CONFIG_ASAN 00:22:44.436 #undef SPDK_CONFIG_AVAHI 00:22:44.436 #undef SPDK_CONFIG_CET 00:22:44.436 #define SPDK_CONFIG_COVERAGE 1 00:22:44.436 #define SPDK_CONFIG_CROSS_PREFIX 00:22:44.436 #undef SPDK_CONFIG_CRYPTO 00:22:44.436 #undef SPDK_CONFIG_CRYPTO_MLX5 00:22:44.436 #undef SPDK_CONFIG_CUSTOMOCF 00:22:44.436 #undef SPDK_CONFIG_DAOS 00:22:44.436 #define SPDK_CONFIG_DAOS_DIR 00:22:44.436 #define SPDK_CONFIG_DEBUG 1 00:22:44.436 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:22:44.436 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build 00:22:44.436 #define SPDK_CONFIG_DPDK_INC_DIR 00:22:44.436 #define SPDK_CONFIG_DPDK_LIB_DIR 00:22:44.436 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:22:44.436 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/lib/env_dpdk 00:22:44.436 #define SPDK_CONFIG_EXAMPLES 1 00:22:44.436 #undef SPDK_CONFIG_FC 00:22:44.436 #define SPDK_CONFIG_FC_PATH 00:22:44.436 #define SPDK_CONFIG_FIO_PLUGIN 1 00:22:44.436 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:22:44.436 #undef SPDK_CONFIG_FUSE 00:22:44.436 #undef SPDK_CONFIG_FUZZER 00:22:44.436 #define SPDK_CONFIG_FUZZER_LIB 00:22:44.436 #undef SPDK_CONFIG_GOLANG 00:22:44.436 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:22:44.436 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:22:44.436 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:22:44.436 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:22:44.436 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:22:44.436 #undef SPDK_CONFIG_HAVE_LIBBSD 00:22:44.436 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:22:44.436 #define SPDK_CONFIG_IDXD 1 00:22:44.436 #undef SPDK_CONFIG_IDXD_KERNEL 00:22:44.436 #undef SPDK_CONFIG_IPSEC_MB 00:22:44.436 #define SPDK_CONFIG_IPSEC_MB_DIR 00:22:44.436 #define SPDK_CONFIG_ISAL 1 00:22:44.436 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:22:44.436 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:22:44.436 #define SPDK_CONFIG_LIBDIR 00:22:44.436 #undef SPDK_CONFIG_LTO 00:22:44.436 #define SPDK_CONFIG_MAX_LCORES 00:22:44.436 #define SPDK_CONFIG_NVME_CUSE 1 00:22:44.436 #undef SPDK_CONFIG_OCF 00:22:44.436 #define SPDK_CONFIG_OCF_PATH 00:22:44.436 #define SPDK_CONFIG_OPENSSL_PATH 00:22:44.436 #undef SPDK_CONFIG_PGO_CAPTURE 00:22:44.436 #define SPDK_CONFIG_PGO_DIR 00:22:44.436 #undef SPDK_CONFIG_PGO_USE 00:22:44.436 #define SPDK_CONFIG_PREFIX /usr/local 00:22:44.436 #undef SPDK_CONFIG_RAID5F 00:22:44.436 #undef SPDK_CONFIG_RBD 00:22:44.436 #define SPDK_CONFIG_RDMA 1 00:22:44.436 #define SPDK_CONFIG_RDMA_PROV verbs 00:22:44.436 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:22:44.436 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:22:44.436 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:22:44.436 #define SPDK_CONFIG_SHARED 1 00:22:44.436 #undef SPDK_CONFIG_SMA 00:22:44.436 #define SPDK_CONFIG_TESTS 1 00:22:44.436 #undef SPDK_CONFIG_TSAN 00:22:44.436 #define SPDK_CONFIG_UBLK 1 00:22:44.436 #define SPDK_CONFIG_UBSAN 1 00:22:44.436 #undef SPDK_CONFIG_UNIT_TESTS 00:22:44.436 #undef SPDK_CONFIG_URING 00:22:44.436 #define SPDK_CONFIG_URING_PATH 00:22:44.436 #undef SPDK_CONFIG_URING_ZNS 00:22:44.436 #undef SPDK_CONFIG_USDT 00:22:44.436 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:22:44.436 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:22:44.436 #undef SPDK_CONFIG_VFIO_USER 00:22:44.436 #define SPDK_CONFIG_VFIO_USER_DIR 00:22:44.436 #define SPDK_CONFIG_VHOST 1 00:22:44.436 #define SPDK_CONFIG_VIRTIO 1 00:22:44.436 #undef SPDK_CONFIG_VTUNE 00:22:44.436 #define SPDK_CONFIG_VTUNE_DIR 00:22:44.437 #define SPDK_CONFIG_WERROR 1 00:22:44.437 #define SPDK_CONFIG_WPDK_DIR 00:22:44.437 #undef SPDK_CONFIG_XNVME 00:22:44.437 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:22:44.437 15:23:47 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:22:44.437 15:23:47 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:22:44.437 15:23:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:44.437 15:23:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:44.437 15:23:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:44.437 15:23:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.437 15:23:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.437 15:23:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.437 15:23:47 -- paths/export.sh@5 -- # export PATH 00:22:44.437 15:23:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.437 15:23:47 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:22:44.437 15:23:47 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/common 00:22:44.437 15:23:47 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:22:44.437 15:23:47 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm 00:22:44.437 15:23:47 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/../../../ 00:22:44.437 15:23:47 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:22:44.437 15:23:47 -- pm/common@67 -- # TEST_TAG=N/A 00:22:44.437 15:23:47 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/.run_test_name 00:22:44.437 15:23:47 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:22:44.437 15:23:47 -- pm/common@71 -- # uname -s 00:22:44.437 15:23:47 -- pm/common@71 -- # PM_OS=Linux 00:22:44.437 15:23:47 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:22:44.437 15:23:47 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:22:44.437 15:23:47 -- pm/common@76 -- # [[ Linux == Linux ]] 00:22:44.437 15:23:47 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:22:44.437 15:23:47 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:22:44.437 15:23:47 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:22:44.437 15:23:47 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:22:44.437 15:23:47 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:22:44.437 15:23:47 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:22:44.437 15:23:47 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power 00:22:44.437 15:23:47 -- common/autotest_common.sh@57 -- # : 1 00:22:44.437 15:23:47 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:22:44.437 15:23:47 -- common/autotest_common.sh@61 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:22:44.437 15:23:47 -- common/autotest_common.sh@63 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:22:44.437 15:23:47 -- common/autotest_common.sh@65 -- # : 1 00:22:44.437 15:23:47 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:22:44.437 15:23:47 -- common/autotest_common.sh@67 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:22:44.437 15:23:47 -- common/autotest_common.sh@69 -- # : 00:22:44.437 15:23:47 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:22:44.437 15:23:47 -- common/autotest_common.sh@71 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:22:44.437 15:23:47 -- common/autotest_common.sh@73 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:22:44.437 15:23:47 -- common/autotest_common.sh@75 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:22:44.437 15:23:47 -- common/autotest_common.sh@77 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:22:44.437 15:23:47 -- common/autotest_common.sh@79 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:22:44.437 15:23:47 -- common/autotest_common.sh@81 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:22:44.437 15:23:47 -- common/autotest_common.sh@83 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:22:44.437 15:23:47 -- common/autotest_common.sh@85 -- # : 1 00:22:44.437 15:23:47 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:22:44.437 15:23:47 -- common/autotest_common.sh@87 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:22:44.437 15:23:47 -- common/autotest_common.sh@89 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:22:44.437 15:23:47 -- common/autotest_common.sh@91 -- # : 1 00:22:44.437 15:23:47 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:22:44.437 15:23:47 -- common/autotest_common.sh@93 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:22:44.437 15:23:47 -- common/autotest_common.sh@95 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:22:44.437 15:23:47 -- common/autotest_common.sh@97 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:22:44.437 15:23:47 -- common/autotest_common.sh@99 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:22:44.437 15:23:47 -- common/autotest_common.sh@101 -- # : rdma 00:22:44.437 15:23:47 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:22:44.437 15:23:47 -- common/autotest_common.sh@103 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:22:44.437 15:23:47 -- common/autotest_common.sh@105 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:22:44.437 15:23:47 -- common/autotest_common.sh@107 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:22:44.437 15:23:47 -- common/autotest_common.sh@109 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:22:44.437 15:23:47 -- common/autotest_common.sh@111 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:22:44.437 15:23:47 -- common/autotest_common.sh@113 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:22:44.437 15:23:47 -- common/autotest_common.sh@115 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:22:44.437 15:23:47 -- common/autotest_common.sh@117 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:22:44.437 15:23:47 -- common/autotest_common.sh@119 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:22:44.437 15:23:47 -- common/autotest_common.sh@121 -- # : 1 00:22:44.437 15:23:47 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:22:44.437 15:23:47 -- common/autotest_common.sh@123 -- # : 00:22:44.437 15:23:47 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:22:44.437 15:23:47 -- common/autotest_common.sh@125 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:22:44.437 15:23:47 -- common/autotest_common.sh@127 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:22:44.437 15:23:47 -- common/autotest_common.sh@129 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:22:44.437 15:23:47 -- common/autotest_common.sh@131 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:22:44.437 15:23:47 -- common/autotest_common.sh@133 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:22:44.437 15:23:47 -- common/autotest_common.sh@135 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:22:44.437 15:23:47 -- common/autotest_common.sh@137 -- # : 00:22:44.437 15:23:47 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:22:44.437 15:23:47 -- common/autotest_common.sh@139 -- # : true 00:22:44.437 15:23:47 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:22:44.437 15:23:47 -- common/autotest_common.sh@141 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:22:44.437 15:23:47 -- common/autotest_common.sh@143 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:22:44.437 15:23:47 -- common/autotest_common.sh@145 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:22:44.437 15:23:47 -- common/autotest_common.sh@147 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:22:44.437 15:23:47 -- common/autotest_common.sh@149 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:22:44.437 15:23:47 -- common/autotest_common.sh@151 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:22:44.437 15:23:47 -- common/autotest_common.sh@153 -- # : e810 00:22:44.437 15:23:47 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:22:44.437 15:23:47 -- common/autotest_common.sh@155 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:22:44.437 15:23:47 -- common/autotest_common.sh@157 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:22:44.437 15:23:47 -- common/autotest_common.sh@159 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:22:44.437 15:23:47 -- common/autotest_common.sh@161 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:22:44.437 15:23:47 -- common/autotest_common.sh@163 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:22:44.437 15:23:47 -- common/autotest_common.sh@166 -- # : 00:22:44.437 15:23:47 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:22:44.437 15:23:47 -- common/autotest_common.sh@168 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:22:44.437 15:23:47 -- common/autotest_common.sh@170 -- # : 0 00:22:44.437 15:23:47 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:22:44.437 15:23:47 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:22:44.437 15:23:47 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:22:44.437 15:23:47 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/python 00:22:44.437 15:23:47 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:22:44.437 15:23:47 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:22:44.437 15:23:47 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:22:44.437 15:23:47 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:22:44.437 15:23:47 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:22:44.437 15:23:47 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:22:44.437 15:23:47 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:22:44.437 15:23:47 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:22:44.437 15:23:47 -- common/autotest_common.sh@199 -- # cat 00:22:44.437 15:23:47 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:22:44.437 15:23:47 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:22:44.437 15:23:47 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:22:44.437 15:23:47 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:22:44.437 15:23:47 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:22:44.437 15:23:47 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:22:44.437 15:23:47 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:22:44.437 15:23:47 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:22:44.437 15:23:47 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin 00:22:44.437 15:23:47 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:22:44.437 15:23:47 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples 00:22:44.437 15:23:47 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:22:44.437 15:23:47 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:22:44.437 15:23:47 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:22:44.437 15:23:47 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:22:44.437 15:23:47 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:22:44.437 15:23:47 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:22:44.437 15:23:47 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:22:44.437 15:23:47 -- common/autotest_common.sh@252 -- # export valgrind= 00:22:44.437 15:23:47 -- common/autotest_common.sh@252 -- # valgrind= 00:22:44.437 15:23:47 -- common/autotest_common.sh@258 -- # uname -s 00:22:44.437 15:23:47 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:22:44.437 15:23:47 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:22:44.437 15:23:47 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:22:44.437 15:23:47 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:22:44.437 15:23:47 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:22:44.437 15:23:47 -- common/autotest_common.sh@268 -- # MAKE=make 00:22:44.437 15:23:47 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j72 00:22:44.437 15:23:47 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:22:44.437 15:23:47 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:22:44.437 15:23:47 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:22:44.437 15:23:47 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:22:44.437 15:23:47 -- common/autotest_common.sh@289 -- # for i in "$@" 00:22:44.437 15:23:47 -- common/autotest_common.sh@290 -- # case "$i" in 00:22:44.437 15:23:47 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:22:44.437 15:23:47 -- common/autotest_common.sh@307 -- # [[ -z 699281 ]] 00:22:44.437 15:23:47 -- common/autotest_common.sh@307 -- # kill -0 699281 00:22:44.437 15:23:47 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:22:44.437 15:23:47 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:22:44.437 15:23:47 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:22:44.437 15:23:47 -- common/autotest_common.sh@320 -- # local mount target_dir 00:22:44.437 15:23:47 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:22:44.437 15:23:47 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:22:44.437 15:23:47 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:22:44.438 15:23:47 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:22:44.438 15:23:47 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.TS5q40 00:22:44.438 15:23:47 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:22:44.438 15:23:47 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target /tmp/spdk.TS5q40/tests/target /tmp/spdk.TS5q40 00:22:44.438 15:23:47 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@316 -- # df -T 00:22:44.438 15:23:47 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=902680576 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=4381749248 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=89014468608 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=94519009280 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=5504540672 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=47253778432 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47259504640 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=5726208 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=18880749568 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=18903801856 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=23052288 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=47259193344 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47259504640 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=311296 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # avails["$mount"]=9451896832 00:22:44.438 15:23:47 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9451900928 00:22:44.438 15:23:47 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:22:44.438 15:23:47 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:22:44.438 15:23:47 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:22:44.438 * Looking for test storage... 00:22:44.438 15:23:47 -- common/autotest_common.sh@357 -- # local target_space new_size 00:22:44.438 15:23:47 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:22:44.438 15:23:47 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.438 15:23:47 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:22:44.438 15:23:47 -- common/autotest_common.sh@361 -- # mount=/ 00:22:44.438 15:23:47 -- common/autotest_common.sh@363 -- # target_space=89014468608 00:22:44.438 15:23:47 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:22:44.438 15:23:47 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:22:44.438 15:23:47 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@370 -- # new_size=7719133184 00:22:44.438 15:23:47 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:22:44.438 15:23:47 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.438 15:23:47 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.438 15:23:47 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.438 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:44.438 15:23:47 -- common/autotest_common.sh@378 -- # return 0 00:22:44.438 15:23:47 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:22:44.438 15:23:47 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:22:44.438 15:23:47 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:22:44.438 15:23:47 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:22:44.438 15:23:47 -- common/autotest_common.sh@1673 -- # true 00:22:44.438 15:23:47 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:22:44.438 15:23:47 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:22:44.438 15:23:47 -- common/autotest_common.sh@27 -- # exec 00:22:44.438 15:23:47 -- common/autotest_common.sh@29 -- # exec 00:22:44.438 15:23:47 -- common/autotest_common.sh@31 -- # xtrace_restore 00:22:44.438 15:23:47 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:22:44.438 15:23:47 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:22:44.438 15:23:47 -- common/autotest_common.sh@18 -- # set -x 00:22:44.438 15:23:47 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:22:44.438 15:23:47 -- nvmf/common.sh@7 -- # uname -s 00:22:44.438 15:23:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:44.438 15:23:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:44.438 15:23:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:44.438 15:23:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:44.438 15:23:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:44.438 15:23:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:44.438 15:23:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:44.438 15:23:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:44.438 15:23:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:44.438 15:23:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:44.438 15:23:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:22:44.438 15:23:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:22:44.438 15:23:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:44.438 15:23:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:44.438 15:23:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:44.438 15:23:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:44.438 15:23:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:22:44.438 15:23:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:44.438 15:23:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:44.438 15:23:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:44.438 15:23:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 15:23:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 15:23:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 15:23:47 -- paths/export.sh@5 -- # export PATH 00:22:44.438 15:23:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.438 15:23:47 -- nvmf/common.sh@47 -- # : 0 00:22:44.438 15:23:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:44.438 15:23:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:44.438 15:23:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:44.438 15:23:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:44.438 15:23:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:44.438 15:23:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:44.438 15:23:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:44.438 15:23:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:44.438 15:23:47 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:22:44.438 15:23:47 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:22:44.438 15:23:47 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:44.438 15:23:47 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:22:44.438 15:23:47 -- target/device_removal.sh@18 -- # nvmftestinit 00:22:44.438 15:23:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:44.438 15:23:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:44.438 15:23:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:44.438 15:23:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:44.438 15:23:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:44.438 15:23:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.438 15:23:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.438 15:23:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.438 15:23:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:44.438 15:23:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:44.438 15:23:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:44.438 15:23:47 -- common/autotest_common.sh@10 -- # set +x 00:22:51.009 15:23:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.009 15:23:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:51.009 15:23:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:51.009 15:23:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:51.009 15:23:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:51.009 15:23:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:51.009 15:23:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:51.009 15:23:54 -- nvmf/common.sh@295 -- # net_devs=() 00:22:51.009 15:23:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:51.009 15:23:54 -- nvmf/common.sh@296 -- # e810=() 00:22:51.009 15:23:54 -- nvmf/common.sh@296 -- # local -ga e810 00:22:51.009 15:23:54 -- nvmf/common.sh@297 -- # x722=() 00:22:51.009 15:23:54 -- nvmf/common.sh@297 -- # local -ga x722 00:22:51.009 15:23:54 -- nvmf/common.sh@298 -- # mlx=() 00:22:51.009 15:23:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:51.009 15:23:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.009 15:23:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:51.009 15:23:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:22:51.009 Found 0000:18:00.0 (0x8086 - 0x1592) 00:22:51.009 15:23:54 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:51.009 15:23:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:51.009 15:23:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:22:51.009 Found 0000:18:00.1 (0x8086 - 0x1592) 00:22:51.009 15:23:54 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:51.009 15:23:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@377 -- # modinfo irdma 00:22:51.009 15:23:54 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:22:51.009 15:23:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:51.009 15:23:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.009 15:23:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.009 15:23:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:22:51.009 Found net devices under 0000:18:00.0: cvl_0_0 00:22:51.009 15:23:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:51.009 15:23:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.009 15:23:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.009 15:23:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:22:51.009 Found net devices under 0000:18:00.1: cvl_0_1 00:22:51.009 15:23:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.009 15:23:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:51.009 15:23:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:51.009 15:23:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:51.009 15:23:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:51.009 15:23:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:51.009 15:23:54 -- nvmf/common.sh@58 -- # uname 00:22:51.009 15:23:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:51.009 15:23:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:51.009 15:23:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:51.009 15:23:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:51.009 15:23:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:51.009 15:23:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:51.009 15:23:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:51.009 15:23:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:51.009 15:23:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:51.009 15:23:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:51.009 15:23:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:51.009 15:23:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:51.009 15:23:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:51.009 15:23:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:51.009 15:23:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:51.010 15:23:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:51.010 15:23:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@105 -- # continue 2 00:22:51.010 15:23:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@105 -- # continue 2 00:22:51.010 15:23:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:51.010 15:23:54 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.010 15:23:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:51.010 15:23:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:22:51.010 2: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:22:51.010 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:22:51.010 altname enp24s0f0np0 00:22:51.010 altname ens785f0np0 00:22:51.010 inet 192.168.100.8/24 scope global cvl_0_0 00:22:51.010 valid_lft forever preferred_lft forever 00:22:51.010 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:22:51.010 valid_lft forever preferred_lft forever 00:22:51.010 15:23:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:51.010 15:23:54 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.010 15:23:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:51.010 15:23:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:22:51.010 3: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:22:51.010 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:22:51.010 altname enp24s0f1np1 00:22:51.010 altname ens785f1np1 00:22:51.010 inet 192.168.100.9/24 scope global cvl_0_1 00:22:51.010 valid_lft forever preferred_lft forever 00:22:51.010 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:22:51.010 valid_lft forever preferred_lft forever 00:22:51.010 15:23:54 -- nvmf/common.sh@411 -- # return 0 00:22:51.010 15:23:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:51.010 15:23:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:51.010 15:23:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:51.010 15:23:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:51.010 15:23:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:51.010 15:23:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:51.010 15:23:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:51.010 15:23:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:51.010 15:23:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:51.010 15:23:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@105 -- # continue 2 00:22:51.010 15:23:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:51.010 15:23:54 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:22:51.010 15:23:54 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@105 -- # continue 2 00:22:51.010 15:23:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:51.010 15:23:54 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.010 15:23:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:51.010 15:23:54 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:51.010 15:23:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:51.010 15:23:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:51.010 192.168.100.9' 00:22:51.010 15:23:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:51.010 192.168.100.9' 00:22:51.010 15:23:54 -- nvmf/common.sh@446 -- # head -n 1 00:22:51.010 15:23:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:51.010 15:23:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:51.010 192.168.100.9' 00:22:51.010 15:23:54 -- nvmf/common.sh@447 -- # tail -n +2 00:22:51.010 15:23:54 -- nvmf/common.sh@447 -- # head -n 1 00:22:51.010 15:23:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:51.010 15:23:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:51.010 15:23:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:51.010 15:23:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:51.010 15:23:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:51.010 15:23:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:51.010 15:23:54 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:22:51.010 15:23:54 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:22:51.010 15:23:54 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:22:51.010 15:23:54 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:22:51.010 15:23:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:51.010 15:23:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:51.010 15:23:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.010 ************************************ 00:22:51.010 START TEST nvmf_device_removal_pci_remove_no_srq 00:22:51.010 ************************************ 00:22:51.010 15:23:54 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:22:51.010 15:23:54 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:22:51.010 15:23:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:51.010 15:23:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:51.010 15:23:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.010 15:23:54 -- nvmf/common.sh@470 -- # nvmfpid=702471 00:22:51.010 15:23:54 -- nvmf/common.sh@471 -- # waitforlisten 702471 00:22:51.010 15:23:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:22:51.010 15:23:54 -- common/autotest_common.sh@817 -- # '[' -z 702471 ']' 00:22:51.010 15:23:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:51.010 15:23:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:51.010 15:23:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:51.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:51.010 15:23:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:51.010 15:23:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.270 [2024-04-24 15:23:54.949838] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:22:51.270 [2024-04-24 15:23:54.949908] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:51.270 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.270 [2024-04-24 15:23:55.032957] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:22:51.270 [2024-04-24 15:23:55.115743] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:51.270 [2024-04-24 15:23:55.115788] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:51.270 [2024-04-24 15:23:55.115798] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:51.270 [2024-04-24 15:23:55.115807] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:51.270 [2024-04-24 15:23:55.115814] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:51.270 [2024-04-24 15:23:55.115866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:51.270 [2024-04-24 15:23:55.115870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:52.209 15:23:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:52.209 15:23:55 -- common/autotest_common.sh@850 -- # return 0 00:22:52.209 15:23:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:52.209 15:23:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:52.209 15:23:55 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:22:52.209 15:23:55 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:22:52.209 15:23:55 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:22:52.209 15:23:55 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 [2024-04-24 15:23:55.820832] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xc5e2e0/0xc5d920) succeed. 00:22:52.209 [2024-04-24 15:23:55.829933] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xc5f590/0xc5dea0) succeed. 00:22:52.209 [2024-04-24 15:23:55.829959] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:22:52.209 15:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:55 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:22:52.209 15:23:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:52.209 15:23:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:52.209 15:23:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:52.209 15:23:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:52.209 15:23:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:52.209 15:23:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.209 15:23:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.209 15:23:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:22:52.209 15:23:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.209 15:23:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:22:52.209 15:23:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:22:52.209 15:23:55 -- nvmf/common.sh@105 -- # continue 2 00:22:52.209 15:23:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:52.209 15:23:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:52.209 15:23:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:22:52.209 15:23:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:22:52.209 15:23:55 -- nvmf/common.sh@105 -- # continue 2 00:22:52.209 15:23:55 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:52.209 15:23:55 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:52.209 15:23:55 -- target/device_removal.sh@27 -- # dev_name=cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_0 00:22:52.209 15:23:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.209 15:23:55 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:22:52.209 15:23:55 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:52.209 15:23:55 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:52.209 15:23:55 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_0 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:55 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_0 -a -s SPDK000cvl_0_0 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:55 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_0 cvl_0_0 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:55 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 [2024-04-24 15:23:55.962939] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:52.209 15:23:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:55 -- target/device_removal.sh@41 -- # return 0 00:22:52.209 15:23:55 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_0 00:22:52.209 15:23:55 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:22:52.209 15:23:55 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@25 -- # local -a dev_name 00:22:52.209 15:23:55 -- target/device_removal.sh@27 -- # dev_name=cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_1 00:22:52.209 15:23:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:52.209 15:23:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:52.209 15:23:55 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:22:52.209 15:23:55 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_1 00:22:52.209 15:23:55 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:22:52.209 15:23:55 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:22:52.209 15:23:55 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_1 00:22:52.209 15:23:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:56 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_1 -a -s SPDK000cvl_0_1 00:22:52.209 15:23:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:56 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_1 cvl_0_1 00:22:52.209 15:23:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 15:23:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:56 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 00:22:52.209 15:23:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:52.209 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:52.209 [2024-04-24 15:23:56.050971] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:22:52.209 15:23:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:52.209 15:23:56 -- target/device_removal.sh@41 -- # return 0 00:22:52.209 15:23:56 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_1 00:22:52.209 15:23:56 -- target/device_removal.sh@53 -- # return 0 00:22:52.209 15:23:56 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf cvl_0_0 cvl_0_1 00:22:52.209 15:23:56 -- target/device_removal.sh@87 -- # dev_names=('cvl_0_0' 'cvl_0_1') 00:22:52.209 15:23:56 -- target/device_removal.sh@87 -- # local dev_names 00:22:52.209 15:23:56 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:22:52.209 15:23:56 -- target/device_removal.sh@91 -- # bdevperf_pid=702684 00:22:52.209 15:23:56 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:52.209 15:23:56 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:22:52.209 15:23:56 -- target/device_removal.sh@94 -- # waitforlisten 702684 /var/tmp/bdevperf.sock 00:22:52.209 15:23:56 -- common/autotest_common.sh@817 -- # '[' -z 702684 ']' 00:22:52.209 15:23:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:52.209 15:23:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:22:52.209 15:23:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:52.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:52.209 15:23:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:22:52.209 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:53.147 15:23:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:22:53.147 15:23:56 -- common/autotest_common.sh@850 -- # return 0 00:22:53.148 15:23:56 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:22:53.148 15:23:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.148 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:53.148 15:23:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.148 15:23:56 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:53.148 15:23:56 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_0 00:22:53.148 15:23:56 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:22:53.148 15:23:56 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:22:53.148 15:23:56 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_0 00:22:53.148 15:23:56 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:53.148 15:23:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:53.148 15:23:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:53.148 15:23:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:53.148 15:23:56 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:22:53.148 15:23:56 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_0 -l -1 -o 1 00:22:53.148 15:23:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.148 15:23:56 -- common/autotest_common.sh@10 -- # set +x 00:22:53.148 Nvme_cvl_0_0n1 00:22:53.148 15:23:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.148 15:23:57 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:22:53.148 15:23:57 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_1 00:22:53.148 15:23:57 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:22:53.148 15:23:57 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:22:53.148 15:23:57 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_1 00:22:53.148 15:23:57 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:22:53.148 15:23:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:22:53.148 15:23:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:53.148 15:23:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:53.148 15:23:57 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:22:53.148 15:23:57 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_1 -l -1 -o 1 00:22:53.148 15:23:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:53.148 15:23:57 -- common/autotest_common.sh@10 -- # set +x 00:22:53.407 Nvme_cvl_0_1n1 00:22:53.407 15:23:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:53.407 15:23:57 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=702872 00:22:53.407 15:23:57 -- target/device_removal.sh@112 -- # sleep 5 00:22:53.407 15:23:57 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:22:58.683 15:24:02 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:22:58.683 15:24:02 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@71 -- # dev_name=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:22:58.683 15:24:02 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:22:58.683 15:24:02 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep24s0f0 00:22:58.683 15:24:02 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_0 00:22:58.683 15:24:02 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:22:58.683 15:24:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:22:58.683 15:24:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:58.683 15:24:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:58.683 15:24:02 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:22:58.683 15:24:02 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:22:58.683 15:24:02 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:22:58.683 15:24:02 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f0 00:22:58.683 15:24:02 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f0 00:22:58.683 15:24:02 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:58.683 15:24:02 -- target/device_removal.sh@77 -- # grep rocep24s0f0 00:22:58.683 15:24:02 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:58.683 15:24:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.683 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:58.683 15:24:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:58.683 rocep24s0f0 00:22:58.683 15:24:02 -- target/device_removal.sh@78 -- # return 0 00:22:58.683 15:24:02 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@66 -- # dev_name=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@67 -- # echo 1 00:22:58.683 15:24:02 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:22:58.683 15:24:02 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:22:58.683 [2024-04-24 15:24:02.262901] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device rocep24s0f0 is being removed. 00:22:58.683 [2024-04-24 15:24:02.263161] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:58.683 [2024-04-24 15:24:02.263434] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:22:58.943 15:24:02 -- target/device_removal.sh@147 -- # seq 1 10 00:22:58.943 15:24:02 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:22:58.943 15:24:02 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f0 00:22:58.943 15:24:02 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f0 00:22:58.943 15:24:02 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:22:58.943 15:24:02 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:22:58.943 15:24:02 -- target/device_removal.sh@77 -- # grep rocep24s0f0 00:22:58.943 15:24:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:58.943 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:59.202 15:24:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:59.202 15:24:02 -- target/device_removal.sh@78 -- # return 1 00:22:59.202 15:24:02 -- target/device_removal.sh@149 -- # break 00:22:59.202 15:24:02 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:22:59.202 15:24:02 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:22:59.202 15:24:02 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:22:59.202 15:24:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:59.202 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:22:59.202 15:24:02 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:22:59.202 15:24:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:59.202 15:24:02 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:22:59.202 15:24:02 -- target/device_removal.sh@160 -- # rescan_pci 00:22:59.202 15:24:02 -- target/device_removal.sh@57 -- # echo 1 00:22:59.770 [2024-04-24 15:24:03.432745] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xc56b30/0xd7d6f0) succeed. 00:22:59.770 [2024-04-24 15:24:03.432852] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:23:00.030 15:24:03 -- target/device_removal.sh@162 -- # seq 1 10 00:23:00.030 15:24:03 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:00.030 15:24:03 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:23:00.030 15:24:03 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_0 00:23:00.030 15:24:03 -- target/device_removal.sh@164 -- # [[ -z cvl_0_0 ]] 00:23:00.030 15:24:03 -- target/device_removal.sh@166 -- # [[ cvl_0_0 != \c\v\l\_\0\_\0 ]] 00:23:00.030 15:24:03 -- target/device_removal.sh@171 -- # break 00:23:00.030 15:24:03 -- target/device_removal.sh@175 -- # [[ -z cvl_0_0 ]] 00:23:00.030 15:24:03 -- target/device_removal.sh@179 -- # ip link set cvl_0_0 up 00:23:00.030 15:24:03 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_0 00:23:00.030 15:24:03 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:00.030 15:24:03 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:00.030 15:24:03 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:23:00.030 15:24:03 -- target/device_removal.sh@186 -- # seq 1 10 00:23:00.030 15:24:03 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:00.030 [2024-04-24 15:24:03.834716] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:00.030 [2024-04-24 15:24:03.834747] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:23:00.030 [2024-04-24 15:24:03.834761] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:00.030 15:24:03 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:00.030 15:24:03 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:00.030 15:24:03 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:00.030 15:24:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:00.030 15:24:03 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:00.030 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.030 15:24:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:00.030 15:24:03 -- target/device_removal.sh@187 -- # ib_count=2 00:23:00.030 15:24:03 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:00.030 15:24:03 -- target/device_removal.sh@189 -- # break 00:23:00.030 15:24:03 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:23:00.030 15:24:03 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@71 -- # dev_name=cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:23:00.030 15:24:03 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:23:00.030 15:24:03 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep24s0f1 00:23:00.030 15:24:03 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_1 00:23:00.030 15:24:03 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:00.030 15:24:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:00.030 15:24:03 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:23:00.030 15:24:03 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:23:00.030 15:24:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:23:00.030 15:24:03 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:23:00.030 15:24:03 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f1 00:23:00.030 15:24:03 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f1 00:23:00.030 15:24:03 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:00.030 15:24:03 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:00.030 15:24:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:00.030 15:24:03 -- target/device_removal.sh@77 -- # grep rocep24s0f1 00:23:00.030 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.291 15:24:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:00.291 rocep24s0f1 00:23:00.291 15:24:03 -- target/device_removal.sh@78 -- # return 0 00:23:00.291 15:24:03 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_1 00:23:00.291 15:24:03 -- target/device_removal.sh@66 -- # dev_name=cvl_0_1 00:23:00.291 15:24:03 -- target/device_removal.sh@67 -- # echo 1 00:23:00.291 15:24:03 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_1 00:23:00.291 15:24:03 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:23:00.291 15:24:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:23:00.291 [2024-04-24 15:24:03.987923] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device rocep24s0f1 is being removed. 00:23:00.291 [2024-04-24 15:24:03.988152] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:23:00.291 [2024-04-24 15:24:03.992042] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:00.291 [2024-04-24 15:24:03.992069] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 95 00:23:00.291 [2024-04-24 15:24:03.992079] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:23:00.291 [2024-04-24 15:24:03.992088] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.291 [2024-04-24 15:24:03.992097] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.291 [2024-04-24 15:24:03.992105] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992114] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992122] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992130] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992137] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992146] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992155] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992163] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992171] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992179] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992187] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992195] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992203] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992211] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992220] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992228] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992236] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992243] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992251] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992259] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992267] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992275] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992283] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992292] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992300] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992308] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992317] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992325] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992334] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992342] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992350] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992358] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992366] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992374] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992382] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992393] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992402] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992410] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992418] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992426] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992433] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992442] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992450] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992458] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992466] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992474] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992481] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992498] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992506] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992514] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992523] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992531] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992539] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992559] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992567] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992574] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992582] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992590] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992597] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992604] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992611] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992618] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992626] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992633] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992640] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992648] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992655] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992663] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992671] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992679] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992686] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992693] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992701] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992708] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992716] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992723] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992739] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992746] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992753] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992761] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992768] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992776] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992784] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992793] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992800] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992807] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992815] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992823] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992831] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992838] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992845] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992852] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992859] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992870] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992878] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992886] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992893] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992901] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992909] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.992916] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992924] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992932] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992939] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992946] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992953] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992961] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992969] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992976] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992984] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.992991] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.992998] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.292 [2024-04-24 15:24:03.993006] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.993013] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.993020] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.993028] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.993037] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.292 [2024-04-24 15:24:03.993045] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.292 [2024-04-24 15:24:03.993055] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993062] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993070] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993077] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993085] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993093] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993101] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993109] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993117] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993125] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993133] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993140] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993149] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993157] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993164] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993172] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993179] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993187] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993194] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993202] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993210] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993218] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993226] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993234] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993241] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993249] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993257] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993266] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993274] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993282] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993289] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993297] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993304] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993312] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993320] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993328] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993336] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993344] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993352] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993360] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993368] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993376] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993385] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993395] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993403] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993411] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993419] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993428] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993436] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993444] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993453] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993461] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993468] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993476] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993492] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993500] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993508] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993516] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993524] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993531] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993539] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993547] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993554] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993562] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993570] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993578] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:00.293 [2024-04-24 15:24:03.993585] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993593] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.293 [2024-04-24 15:24:03.993601] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:00.293 [2024-04-24 15:24:03.993609] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:00.863 15:24:04 -- target/device_removal.sh@147 -- # seq 1 10 00:23:00.863 15:24:04 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:23:00.863 15:24:04 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f1 00:23:00.863 15:24:04 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f1 00:23:00.863 15:24:04 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:00.863 15:24:04 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:00.863 15:24:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:00.863 15:24:04 -- target/device_removal.sh@77 -- # grep rocep24s0f1 00:23:00.863 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:23:00.863 15:24:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:00.863 15:24:04 -- target/device_removal.sh@78 -- # return 1 00:23:00.863 15:24:04 -- target/device_removal.sh@149 -- # break 00:23:00.863 15:24:04 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:00.863 15:24:04 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:00.863 15:24:04 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:00.863 15:24:04 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:00.863 15:24:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:00.863 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:23:00.863 15:24:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:00.863 15:24:04 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:23:00.863 15:24:04 -- target/device_removal.sh@160 -- # rescan_pci 00:23:00.863 15:24:04 -- target/device_removal.sh@57 -- # echo 1 00:23:01.432 [2024-04-24 15:24:05.110126] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xc56f20/0xc4ae20) succeed. 00:23:01.432 [2024-04-24 15:24:05.110221] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:23:01.432 [2024-04-24 15:24:05.110282] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:23:01.692 15:24:05 -- target/device_removal.sh@162 -- # seq 1 10 00:23:01.692 15:24:05 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:01.692 15:24:05 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:23:01.692 15:24:05 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_1 00:23:01.692 15:24:05 -- target/device_removal.sh@164 -- # [[ -z cvl_0_1 ]] 00:23:01.692 15:24:05 -- target/device_removal.sh@166 -- # [[ cvl_0_1 != \c\v\l\_\0\_\1 ]] 00:23:01.692 15:24:05 -- target/device_removal.sh@171 -- # break 00:23:01.692 15:24:05 -- target/device_removal.sh@175 -- # [[ -z cvl_0_1 ]] 00:23:01.692 15:24:05 -- target/device_removal.sh@179 -- # ip link set cvl_0_1 up 00:23:01.692 15:24:05 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_1 00:23:01.692 15:24:05 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:23:01.692 15:24:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:01.692 15:24:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:23:01.692 15:24:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:01.692 15:24:05 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:01.692 15:24:05 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:23:01.692 [2024-04-24 15:24:05.458747] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:01.692 [2024-04-24 15:24:05.458776] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:23:01.692 [2024-04-24 15:24:05.458790] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:01.692 15:24:05 -- target/device_removal.sh@186 -- # seq 1 10 00:23:01.692 15:24:05 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:01.692 15:24:05 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:01.692 15:24:05 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:01.692 15:24:05 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:01.692 15:24:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:01.692 15:24:05 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:01.692 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:23:01.692 15:24:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:01.692 15:24:05 -- target/device_removal.sh@187 -- # ib_count=2 00:23:01.692 15:24:05 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:01.692 15:24:05 -- target/device_removal.sh@189 -- # break 00:23:01.692 15:24:05 -- target/device_removal.sh@200 -- # stop_bdevperf 00:23:01.692 15:24:05 -- target/device_removal.sh@116 -- # wait 702872 00:24:38.167 0 00:24:38.167 15:25:27 -- target/device_removal.sh@118 -- # killprocess 702684 00:24:38.167 15:25:27 -- common/autotest_common.sh@936 -- # '[' -z 702684 ']' 00:24:38.167 15:25:27 -- common/autotest_common.sh@940 -- # kill -0 702684 00:24:38.167 15:25:27 -- common/autotest_common.sh@941 -- # uname 00:24:38.167 15:25:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:38.167 15:25:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 702684 00:24:38.167 15:25:27 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:24:38.167 15:25:27 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:24:38.167 15:25:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 702684' 00:24:38.167 killing process with pid 702684 00:24:38.167 15:25:27 -- common/autotest_common.sh@955 -- # kill 702684 00:24:38.167 15:25:27 -- common/autotest_common.sh@960 -- # wait 702684 00:24:38.167 15:25:27 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:24:38.167 15:25:27 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:38.167 [2024-04-24 15:23:56.105616] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:24:38.167 [2024-04-24 15:23:56.105675] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid702684 ] 00:24:38.167 EAL: No free 2048 kB hugepages reported on node 1 00:24:38.167 [2024-04-24 15:23:56.182750] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:38.167 [2024-04-24 15:23:56.266331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:38.167 Running I/O for 90 seconds... 00:24:38.167 [2024-04-24 15:24:02.261072] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.167 [2024-04-24 15:24:02.261113] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.167 [2024-04-24 15:24:02.261125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.167 [2024-04-24 15:24:02.261137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.167 [2024-04-24 15:24:02.261147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.167 [2024-04-24 15:24:02.261157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.167 [2024-04-24 15:24:02.261167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.167 [2024-04-24 15:24:02.261177] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.167 [2024-04-24 15:24:02.261186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.168 [2024-04-24 15:24:02.263212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:38.168 [2024-04-24 15:24:02.263230] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:24:38.168 [2024-04-24 15:24:02.263363] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.168 [2024-04-24 15:24:02.270896] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.280920] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.291651] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.301883] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.312177] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.322576] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.332726] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.342765] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.353302] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.364390] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.374457] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.385291] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.395398] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.407162] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.417188] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.427536] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.437563] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.448309] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.458336] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.468723] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.478742] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.489363] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.499390] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.510533] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.520561] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.530905] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.541133] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.552757] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.563303] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.573329] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.583686] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.594086] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.604110] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.614465] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.624481] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.635082] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.645110] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.655635] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.665660] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.675945] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.685971] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.696286] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.706897] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.716948] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.727377] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.737404] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.747572] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.757619] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.767806] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.777836] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.788046] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.798200] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.808554] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.818706] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.829076] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.839226] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.849797] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.860662] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.871126] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.881281] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.891640] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.901983] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.912255] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.922447] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.933065] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.943266] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.953459] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.963490] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.973822] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.983853] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:02.994039] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.004116] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.014416] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.024534] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.034890] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.045068] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.055421] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.065691] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.075718] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.085743] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.095957] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.107090] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.117183] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.127210] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.137493] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.147514] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.168 [2024-04-24 15:24:03.157552] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.167578] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.177602] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.187628] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.197653] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.207680] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.217705] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.227731] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.237757] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.247783] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.257810] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:38.169 [2024-04-24 15:24:03.265816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:209064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:209072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:209080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:209088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:209096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:209104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:209112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.265988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:209120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.265998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:209128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:209136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:209144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:209152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:209160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:209168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:209176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:209184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:209192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:209200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:209208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:209216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:209224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:209232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:209240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:209248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:209256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:209264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:209272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:209280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:209288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:209296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:209304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:209312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:209320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:209328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.169 [2024-04-24 15:24:03.266566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.169 [2024-04-24 15:24:03.266578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:209336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:209344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:209352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:209360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:209368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:209376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:209384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:209392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:209400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:209408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:209416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:209424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:209432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:209440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:209448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:209456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:209464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:209472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:209480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:209488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.266989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:209496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.266999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:209504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:209512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:209520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:209528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:209536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:209544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:209552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:209560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:209568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:209576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:209584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:209592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:209600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:209608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.170 [2024-04-24 15:24:03.267291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.170 [2024-04-24 15:24:03.267302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:209616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:209624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:209632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:209640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:209648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:209656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:209664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:209672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:209680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:209688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:209696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:209704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:209712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:209720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:209728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:209736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:209744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:209752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:209760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:209768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:209776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:209784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:209792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:209800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:209808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:209816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:209824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:209832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:209840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:209848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:209856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:209864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:209872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.267990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:209880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.267999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:209888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.268020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:209896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.268043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:209904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.268063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:209912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.171 [2024-04-24 15:24:03.268083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:208896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x22fd9f10 00:24:38.171 [2024-04-24 15:24:03.268105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.171 [2024-04-24 15:24:03.268116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:208904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:208912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:208920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:208928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:208936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:208944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:208952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:208960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:208968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:208976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:208984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:208992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:209000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:209008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:209016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:209024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:209032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:209040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.268507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:209048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x22fd9f10 00:24:38.172 [2024-04-24 15:24:03.268516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.281472] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:24:38.172 [2024-04-24 15:24:03.281541] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:38.172 [2024-04-24 15:24:03.281551] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:38.172 [2024-04-24 15:24:03.281561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:209056 len:8 PRP1 0x0 PRP2 0x0 00:24:38.172 [2024-04-24 15:24:03.281572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.282262] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:24:38.172 [2024-04-24 15:24:03.988828] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.172 [2024-04-24 15:24:03.988862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.172 [2024-04-24 15:24:03.988875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.988888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.172 [2024-04-24 15:24:03.988897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.988908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.172 [2024-04-24 15:24:03.988917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.988927] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:38.172 [2024-04-24 15:24:03.988936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32616 cdw0:6 sqhd:c3b9 p:0 m:0 dnr:0 00:24:38.172 [2024-04-24 15:24:03.991783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:38.172 [2024-04-24 15:24:03.991808] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:24:38.172 [2024-04-24 15:24:03.991989] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.172 [2024-04-24 15:24:03.993023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:151224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.172 [2024-04-24 15:24:03.993038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:151232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:151240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:151248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:151256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:151264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:151272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:151280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:151288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:151296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:151304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:151312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:151320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:151328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:151336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:151344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:151352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:151360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:151368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:151376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:151384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:151392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:151400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:151408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:151416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:151424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:151432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:151440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:151448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:151456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:151464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:151472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:151480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:151488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:151496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:151504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:151512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:151520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:151528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:151536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.173 [2024-04-24 15:24:03.993892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.173 [2024-04-24 15:24:03.993903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:151544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:38.174 [2024-04-24 15:24:03.993912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.993924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:150528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fe000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.993934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.993944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:150536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fc000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.993954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.993965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:150544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079fa000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.993975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.993986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:150552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f8000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.993995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:150560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f6000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:150568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f4000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:150576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f2000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:150584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f0000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:150592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ee000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:150600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ec000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:150608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ea000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:150616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e8000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:150624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e6000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:150632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:150640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:150648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:150656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:150664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:150672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:150680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:150688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:150696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:150704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:150712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:150720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:150728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:150736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:150744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:150752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:150760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:150768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c2000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:150776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c0000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:150784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079be000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:150792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079bc000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:150800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.174 [2024-04-24 15:24:03.994657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:150808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0x6b51d025 00:24:38.174 [2024-04-24 15:24:03.994666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:150816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:150824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:150832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:150840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:150848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:150856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:150864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:150872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:150880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:150888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:150896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:150904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:150912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:150920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:150928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.994990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:150936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.994999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:150944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:150952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:150960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:150968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:150976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:150984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:150992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:151000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:151008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:151016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:151024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:151032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:151040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:151048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:151056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:151064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:151072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:151080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:151088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.175 [2024-04-24 15:24:03.995402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:151096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x6b51d025 00:24:38.175 [2024-04-24 15:24:03.995412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:03.995423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:151104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:03.995432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:03.995442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:151112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:03.995454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:151120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:151128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:151136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:151144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:151152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:151160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:151168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:151176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:151184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:151192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:151200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.009843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:151208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x6b51d025 00:24:38.176 [2024-04-24 15:24:04.009853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32616 cdw0:762b8e0 sqhd:8530 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.022824] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:38.176 [2024-04-24 15:24:04.022839] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:38.176 [2024-04-24 15:24:04.022848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:151216 len:8 PRP1 0x0 PRP2 0x0 00:24:38.176 [2024-04-24 15:24:04.022858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:38.176 [2024-04-24 15:24:04.022907] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:24:38.176 [2024-04-24 15:24:04.023142] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:38.176 [2024-04-24 15:24:04.023156] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:38.176 [2024-04-24 15:24:04.023164] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:38.176 [2024-04-24 15:24:04.023182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:38.176 [2024-04-24 15:24:04.023192] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:24:38.176 [2024-04-24 15:24:04.023207] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:24:38.176 [2024-04-24 15:24:04.023217] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:24:38.176 [2024-04-24 15:24:04.023227] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:24:38.176 [2024-04-24 15:24:04.023248] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:38.176 [2024-04-24 15:24:04.023257] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:24:38.176 [2024-04-24 15:24:04.095663] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -101) 00:24:38.176 [2024-04-24 15:24:04.095681] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:38.176 [2024-04-24 15:24:04.095690] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:38.176 [2024-04-24 15:24:04.095705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:38.176 [2024-04-24 15:24:04.095718] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:24:38.176 [2024-04-24 15:24:04.095730] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:24:38.176 [2024-04-24 15:24:04.095740] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:24:38.176 [2024-04-24 15:24:04.095749] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:24:38.176 [2024-04-24 15:24:04.095769] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:38.176 [2024-04-24 15:24:04.095778] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:24:38.176 [2024-04-24 15:24:05.154103] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:38.176 [2024-04-24 15:24:06.028284] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:38.176 [2024-04-24 15:24:06.028324] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:38.176 [2024-04-24 15:24:06.028352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:38.176 [2024-04-24 15:24:06.028363] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:24:38.176 [2024-04-24 15:24:06.028701] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:24:38.176 [2024-04-24 15:24:06.028713] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:24:38.176 [2024-04-24 15:24:06.028724] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:24:38.176 [2024-04-24 15:24:06.028744] bdev_nvme.c:2871:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:24:38.176 [2024-04-24 15:24:06.028768] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:38.176 [2024-04-24 15:24:06.028799] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:24:38.176 [2024-04-24 15:24:06.082001] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:38.176 00:24:38.176 Latency(us) 00:24:38.176 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:38.176 Job: Nvme_cvl_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:38.176 Verification LBA range: start 0x0 length 0x8000 00:24:38.176 Nvme_cvl_0_0n1 : 90.01 11548.77 45.11 0.00 0.00 11063.56 2222.53 3034487.76 00:24:38.176 Job: Nvme_cvl_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:38.176 Verification LBA range: start 0x0 length 0x8000 00:24:38.177 Nvme_cvl_0_1n1 : 90.01 11349.15 44.33 0.00 0.00 11257.66 2350.75 3049076.65 00:24:38.177 =================================================================================================================== 00:24:38.177 Total : 22897.92 89.44 0.00 0.00 11159.77 2222.53 3049076.65 00:24:38.177 Received shutdown signal, test time was about 90.000000 seconds 00:24:38.177 00:24:38.177 Latency(us) 00:24:38.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:38.177 =================================================================================================================== 00:24:38.177 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:38.177 15:25:27 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:24:38.177 15:25:27 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:38.177 15:25:27 -- target/device_removal.sh@202 -- # killprocess 702471 00:24:38.177 15:25:27 -- common/autotest_common.sh@936 -- # '[' -z 702471 ']' 00:24:38.177 15:25:27 -- common/autotest_common.sh@940 -- # kill -0 702471 00:24:38.177 15:25:27 -- common/autotest_common.sh@941 -- # uname 00:24:38.177 15:25:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:38.177 15:25:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 702471 00:24:38.177 15:25:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:38.177 15:25:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:38.177 15:25:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 702471' 00:24:38.177 killing process with pid 702471 00:24:38.177 15:25:27 -- common/autotest_common.sh@955 -- # kill 702471 00:24:38.177 15:25:27 -- common/autotest_common.sh@960 -- # wait 702471 00:24:38.177 [2024-04-24 15:25:27.871091] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:38.177 15:25:28 -- target/device_removal.sh@203 -- # nvmfpid= 00:24:38.177 15:25:28 -- target/device_removal.sh@205 -- # return 0 00:24:38.177 00:24:38.177 real 1m33.290s 00:24:38.177 user 4m36.775s 00:24:38.177 sys 0m2.020s 00:24:38.177 15:25:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:38.177 15:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 ************************************ 00:24:38.177 END TEST nvmf_device_removal_pci_remove_no_srq 00:24:38.177 ************************************ 00:24:38.177 15:25:28 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:24:38.177 15:25:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:38.177 15:25:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:38.177 15:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 ************************************ 00:24:38.177 START TEST nvmf_device_removal_pci_remove 00:24:38.177 ************************************ 00:24:38.177 15:25:28 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:24:38.177 15:25:28 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:24:38.177 15:25:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:38.177 15:25:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:38.177 15:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 15:25:28 -- nvmf/common.sh@470 -- # nvmfpid=715189 00:24:38.177 15:25:28 -- nvmf/common.sh@471 -- # waitforlisten 715189 00:24:38.177 15:25:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:24:38.177 15:25:28 -- common/autotest_common.sh@817 -- # '[' -z 715189 ']' 00:24:38.177 15:25:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:38.177 15:25:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:38.177 15:25:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:38.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:38.177 15:25:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:38.177 15:25:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 [2024-04-24 15:25:28.451101] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:24:38.177 [2024-04-24 15:25:28.451154] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:38.177 EAL: No free 2048 kB hugepages reported on node 1 00:24:38.177 [2024-04-24 15:25:28.532200] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:24:38.177 [2024-04-24 15:25:28.617129] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:38.177 [2024-04-24 15:25:28.617171] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:38.177 [2024-04-24 15:25:28.617181] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:38.177 [2024-04-24 15:25:28.617190] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:38.177 [2024-04-24 15:25:28.617198] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:38.177 [2024-04-24 15:25:28.617249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:38.177 [2024-04-24 15:25:28.617252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:38.177 15:25:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:38.177 15:25:29 -- common/autotest_common.sh@850 -- # return 0 00:24:38.177 15:25:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:38.177 15:25:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 15:25:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:38.177 15:25:29 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:24:38.177 15:25:29 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:24:38.177 15:25:29 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:24:38.177 15:25:29 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:38.177 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 [2024-04-24 15:25:29.308438] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xfb52e0/0xfb4920) succeed. 00:24:38.177 [2024-04-24 15:25:29.317544] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xfb6590/0xfb4ea0) succeed. 00:24:38.177 [2024-04-24 15:25:29.317572] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:24:38.177 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.177 15:25:29 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:24:38.177 15:25:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:38.177 15:25:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:38.177 15:25:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:38.177 15:25:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:38.177 15:25:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:38.177 15:25:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.177 15:25:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.177 15:25:29 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:24:38.177 15:25:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.177 15:25:29 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:24:38.177 15:25:29 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:24:38.177 15:25:29 -- nvmf/common.sh@105 -- # continue 2 00:24:38.177 15:25:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:38.177 15:25:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:38.177 15:25:29 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:24:38.177 15:25:29 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:24:38.177 15:25:29 -- nvmf/common.sh@105 -- # continue 2 00:24:38.177 15:25:29 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:38.177 15:25:29 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:38.177 15:25:29 -- target/device_removal.sh@27 -- # dev_name=cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_0 00:24:38.177 15:25:29 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.177 15:25:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.177 15:25:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.177 15:25:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.177 15:25:29 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:24:38.177 15:25:29 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:38.177 15:25:29 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:38.177 15:25:29 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_0 00:24:38.177 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.177 15:25:29 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_0 -a -s SPDK000cvl_0_0 00:24:38.177 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.177 15:25:29 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_0 cvl_0_0 00:24:38.177 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.177 15:25:29 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 00:24:38.177 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.177 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.177 [2024-04-24 15:25:29.460586] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:38.177 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.177 15:25:29 -- target/device_removal.sh@41 -- # return 0 00:24:38.177 15:25:29 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_0 00:24:38.177 15:25:29 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:38.177 15:25:29 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev cvl_0_1 00:24:38.177 15:25:29 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:38.178 15:25:29 -- target/device_removal.sh@27 -- # dev_name=cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@28 -- # malloc_name=cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@29 -- # get_subsystem_nqn cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@30 -- # get_ip_address cvl_0_1 00:24:38.178 15:25:29 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.178 15:25:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.178 15:25:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.178 15:25:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.178 15:25:29 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:24:38.178 15:25:29 -- target/device_removal.sh@31 -- # serial=SPDK000cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:38.178 15:25:29 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:38.178 15:25:29 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b cvl_0_1 00:24:38.178 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:29 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_cvl_0_1 -a -s SPDK000cvl_0_1 00:24:38.178 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:29 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_cvl_0_1 cvl_0_1 00:24:38.178 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:29 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 00:24:38.178 15:25:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 [2024-04-24 15:25:29.548629] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:38.178 15:25:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:29 -- target/device_removal.sh@41 -- # return 0 00:24:38.178 15:25:29 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@53 -- # return 0 00:24:38.178 15:25:29 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf cvl_0_0 cvl_0_1 00:24:38.178 15:25:29 -- target/device_removal.sh@87 -- # dev_names=('cvl_0_0' 'cvl_0_1') 00:24:38.178 15:25:29 -- target/device_removal.sh@87 -- # local dev_names 00:24:38.178 15:25:29 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:24:38.178 15:25:29 -- target/device_removal.sh@91 -- # bdevperf_pid=715398 00:24:38.178 15:25:29 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:38.178 15:25:29 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:24:38.178 15:25:29 -- target/device_removal.sh@94 -- # waitforlisten 715398 /var/tmp/bdevperf.sock 00:24:38.178 15:25:29 -- common/autotest_common.sh@817 -- # '[' -z 715398 ']' 00:24:38.178 15:25:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:38.178 15:25:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:38.178 15:25:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:38.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:38.178 15:25:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:38.178 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:38.178 15:25:30 -- common/autotest_common.sh@850 -- # return 0 00:24:38.178 15:25:30 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:24:38.178 15:25:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:30 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:30 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:38.178 15:25:30 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_0 00:24:38.178 15:25:30 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_0 00:24:38.178 15:25:30 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_0 00:24:38.178 15:25:30 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_0 00:24:38.178 15:25:30 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.178 15:25:30 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:24:38.178 15:25:30 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_0 -l -1 -o 1 00:24:38.178 15:25:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:30 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 Nvme_cvl_0_0n1 00:24:38.178 15:25:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:30 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:38.178 15:25:30 -- target/device_removal.sh@101 -- # get_subsystem_nqn cvl_0_1 00:24:38.178 15:25:30 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_cvl_0_1 00:24:38.178 15:25:30 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_cvl_0_1 00:24:38.178 15:25:30 -- target/device_removal.sh@102 -- # get_ip_address cvl_0_1 00:24:38.178 15:25:30 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.178 15:25:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.178 15:25:30 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:24:38.178 15:25:30 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_cvl_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_cvl_0_1 -l -1 -o 1 00:24:38.178 15:25:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:30 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 Nvme_cvl_0_1n1 00:24:38.178 15:25:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 15:25:30 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=715585 00:24:38.178 15:25:30 -- target/device_removal.sh@112 -- # sleep 5 00:24:38.178 15:25:30 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:24:38.178 15:25:35 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:38.178 15:25:35 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@71 -- # dev_name=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:24:38.178 15:25:35 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:24:38.178 15:25:35 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep24s0f0 00:24:38.178 15:25:35 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_0 00:24:38.178 15:25:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.178 15:25:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.178 15:25:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.178 15:25:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.178 15:25:35 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:24:38.178 15:25:35 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:24:38.178 15:25:35 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:24:38.178 15:25:35 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f0 00:24:38.178 15:25:35 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f0 00:24:38.178 15:25:35 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:38.178 15:25:35 -- target/device_removal.sh@77 -- # grep rocep24s0f0 00:24:38.178 15:25:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.178 15:25:35 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:38.178 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:24:38.178 15:25:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.178 rocep24s0f0 00:24:38.178 15:25:35 -- target/device_removal.sh@78 -- # return 0 00:24:38.178 15:25:35 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@66 -- # dev_name=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@67 -- # echo 1 00:24:38.178 15:25:35 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@61 -- # dev_name=cvl_0_0 00:24:38.178 15:25:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/cvl_0_0/device 00:24:38.178 [2024-04-24 15:25:35.778261] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device rocep24s0f0 is being removed. 00:24:38.178 [2024-04-24 15:25:35.778549] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.178 [2024-04-24 15:25:35.782553] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:38.178 [2024-04-24 15:25:35.782579] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 32 00:24:38.178 [2024-04-24 15:25:35.782589] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:24:38.178 [2024-04-24 15:25:35.782598] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.178 [2024-04-24 15:25:35.782606] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.178 [2024-04-24 15:25:35.782614] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.178 [2024-04-24 15:25:35.782622] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.178 [2024-04-24 15:25:35.782629] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.178 [2024-04-24 15:25:35.782636] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.178 [2024-04-24 15:25:35.782644] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.178 [2024-04-24 15:25:35.782651] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782659] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782667] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782674] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782682] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782690] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782697] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782705] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782712] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782720] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782727] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782734] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782746] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782754] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782762] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782769] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782777] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782785] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782792] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782799] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782807] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782814] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782822] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782831] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782838] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782846] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782854] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782861] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782868] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782876] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782883] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782891] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782898] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782906] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782913] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782920] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782927] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782934] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782942] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782950] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782957] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782965] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782972] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782979] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.782986] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.782994] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783002] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.783009] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783016] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.783023] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783030] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.783038] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783046] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.783054] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783064] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 [2024-04-24 15:25:35.783072] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.179 [2024-04-24 15:25:35.783080] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.179 15:25:36 -- target/device_removal.sh@147 -- # seq 1 10 00:24:38.179 15:25:36 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:24:38.179 15:25:36 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f0 00:24:38.179 15:25:36 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f0 00:24:38.179 15:25:36 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:38.179 15:25:36 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:38.179 15:25:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.179 15:25:36 -- common/autotest_common.sh@10 -- # set +x 00:24:38.179 15:25:36 -- target/device_removal.sh@77 -- # grep rocep24s0f0 00:24:38.179 15:25:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.179 15:25:36 -- target/device_removal.sh@78 -- # return 1 00:24:38.179 15:25:36 -- target/device_removal.sh@149 -- # break 00:24:38.179 15:25:36 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:38.179 15:25:36 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:38.179 15:25:36 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:38.179 15:25:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.179 15:25:36 -- common/autotest_common.sh@10 -- # set +x 00:24:38.179 15:25:36 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:38.179 15:25:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.179 15:25:36 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:24:38.179 15:25:36 -- target/device_removal.sh@160 -- # rescan_pci 00:24:38.179 15:25:36 -- target/device_removal.sh@57 -- # echo 1 00:24:38.179 [2024-04-24 15:25:37.032006] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xfadb30/0x10d46f0) succeed. 00:24:38.179 [2024-04-24 15:25:37.032115] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:24:38.179 15:25:37 -- target/device_removal.sh@162 -- # seq 1 10 00:24:38.179 15:25:37 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:24:38.179 15:25:37 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:24:38.179 15:25:37 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_0 00:24:38.179 15:25:37 -- target/device_removal.sh@164 -- # [[ -z cvl_0_0 ]] 00:24:38.179 15:25:37 -- target/device_removal.sh@166 -- # [[ cvl_0_0 != \c\v\l\_\0\_\0 ]] 00:24:38.179 15:25:37 -- target/device_removal.sh@171 -- # break 00:24:38.179 15:25:37 -- target/device_removal.sh@175 -- # [[ -z cvl_0_0 ]] 00:24:38.179 15:25:37 -- target/device_removal.sh@179 -- # ip link set cvl_0_0 up 00:24:38.179 15:25:37 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_0 00:24:38.179 15:25:37 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.179 15:25:37 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:24:38.179 15:25:37 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev cvl_0_0 00:24:38.179 15:25:37 -- target/device_removal.sh@186 -- # seq 1 10 00:24:38.179 [2024-04-24 15:25:37.436628] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:38.179 [2024-04-24 15:25:37.436663] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:24:38.179 [2024-04-24 15:25:37.436677] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:38.179 15:25:37 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:24:38.179 15:25:37 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:38.179 15:25:37 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:38.179 15:25:37 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:38.179 15:25:37 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:38.179 15:25:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.179 15:25:37 -- common/autotest_common.sh@10 -- # set +x 00:24:38.179 15:25:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.179 15:25:37 -- target/device_removal.sh@187 -- # ib_count=2 00:24:38.179 15:25:37 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:24:38.179 15:25:37 -- target/device_removal.sh@189 -- # break 00:24:38.179 15:25:37 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:38.179 15:25:37 -- target/device_removal.sh@135 -- # nvme_dev=cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@136 -- # get_rdma_device_name cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@71 -- # dev_name=cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@72 -- # get_pci_dir cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:24:38.179 15:25:37 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:24:38.179 15:25:37 -- target/device_removal.sh@136 -- # rdma_dev_name=rocep24s0f1 00:24:38.179 15:25:37 -- target/device_removal.sh@137 -- # get_ip_address cvl_0_1 00:24:38.179 15:25:37 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.179 15:25:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.179 15:25:37 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:24:38.179 15:25:37 -- target/device_removal.sh@138 -- # get_pci_dir cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:24:38.179 15:25:37 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:24:38.179 15:25:37 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:24:38.179 15:25:37 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f1 00:24:38.179 15:25:37 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f1 00:24:38.180 15:25:37 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:38.180 15:25:37 -- target/device_removal.sh@77 -- # grep rocep24s0f1 00:24:38.180 15:25:37 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:38.180 15:25:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.180 15:25:37 -- common/autotest_common.sh@10 -- # set +x 00:24:38.180 15:25:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.180 rocep24s0f1 00:24:38.180 15:25:37 -- target/device_removal.sh@78 -- # return 0 00:24:38.180 15:25:37 -- target/device_removal.sh@145 -- # remove_one_nic cvl_0_1 00:24:38.180 15:25:37 -- target/device_removal.sh@66 -- # dev_name=cvl_0_1 00:24:38.180 15:25:37 -- target/device_removal.sh@67 -- # echo 1 00:24:38.180 15:25:37 -- target/device_removal.sh@67 -- # get_pci_dir cvl_0_1 00:24:38.180 15:25:37 -- target/device_removal.sh@61 -- # dev_name=cvl_0_1 00:24:38.180 15:25:37 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/cvl_0_1/device 00:24:38.180 [2024-04-24 15:25:37.601162] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device rocep24s0f1 is being removed. 00:24:38.180 [2024-04-24 15:25:37.601401] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:24:38.180 [2024-04-24 15:25:37.605201] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:38.180 [2024-04-24 15:25:37.605232] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 71 00:24:38.180 [2024-04-24 15:25:37.605241] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:24:38.180 [2024-04-24 15:25:37.605249] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605257] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:24:38.180 [2024-04-24 15:25:37.605265] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605273] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605281] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605289] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605298] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605310] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:24:38.180 [2024-04-24 15:25:37.605317] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605325] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605333] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605341] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605348] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605356] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605364] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605372] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605380] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605389] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605396] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605404] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605411] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605418] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605426] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605433] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605442] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605449] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605457] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605464] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605472] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605479] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605495] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605503] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:24:38.180 [2024-04-24 15:25:37.605511] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605519] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605527] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605534] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605542] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605549] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605556] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605564] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605572] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605580] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605587] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605595] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605602] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605609] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605617] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605625] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:24:38.180 [2024-04-24 15:25:37.605633] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605643] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605650] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605658] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605665] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605673] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605683] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605692] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605700] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605709] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605716] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605723] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605738] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605746] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605753] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605762] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605770] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605778] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605785] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605792] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605800] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605808] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605816] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605823] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605832] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605840] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605847] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605855] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605862] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605870] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605879] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605887] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605895] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605903] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605910] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605918] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605926] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605934] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605942] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605952] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605961] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605968] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605978] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.180 [2024-04-24 15:25:37.605986] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.180 [2024-04-24 15:25:37.605994] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606002] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606010] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606019] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606028] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606036] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606044] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606052] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606060] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606069] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606077] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606085] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606092] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606100] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606107] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606115] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606123] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606131] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606139] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606147] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606155] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606162] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606170] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606178] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606186] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606195] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606202] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606210] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606218] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606225] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606233] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606241] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606250] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606259] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606267] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606275] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606285] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606293] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606302] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606311] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606321] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606329] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606336] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606345] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606353] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606362] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606369] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 [2024-04-24 15:25:37.606377] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:24:38.181 [2024-04-24 15:25:37.606386] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:24:38.181 15:25:38 -- target/device_removal.sh@147 -- # seq 1 10 00:24:38.181 15:25:38 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:24:38.181 15:25:38 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt rocep24s0f1 00:24:38.181 15:25:38 -- target/device_removal.sh@76 -- # local rdma_dev_name=rocep24s0f1 00:24:38.181 15:25:38 -- target/device_removal.sh@77 -- # grep rocep24s0f1 00:24:38.181 15:25:38 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:38.181 15:25:38 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:38.181 15:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.181 15:25:38 -- common/autotest_common.sh@10 -- # set +x 00:24:38.181 15:25:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.181 15:25:38 -- target/device_removal.sh@78 -- # return 1 00:24:38.181 15:25:38 -- target/device_removal.sh@149 -- # break 00:24:38.181 15:25:38 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:38.181 15:25:38 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:38.181 15:25:38 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:38.181 15:25:38 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:38.181 15:25:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.181 15:25:38 -- common/autotest_common.sh@10 -- # set +x 00:24:38.181 15:25:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.181 15:25:38 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:24:38.181 15:25:38 -- target/device_removal.sh@160 -- # rescan_pci 00:24:38.181 15:25:38 -- target/device_removal.sh@57 -- # echo 1 00:24:38.181 [2024-04-24 15:25:38.672342] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device irdma0(0xfadf20/0xfa1e20) succeed. 00:24:38.181 [2024-04-24 15:25:38.672463] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:24:38.181 [2024-04-24 15:25:38.672515] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: port active 00:24:38.181 15:25:39 -- target/device_removal.sh@162 -- # seq 1 10 00:24:38.181 15:25:39 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:24:38.181 15:25:39 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:24:38.181 15:25:39 -- target/device_removal.sh@163 -- # new_net_dev=cvl_0_1 00:24:38.181 15:25:39 -- target/device_removal.sh@164 -- # [[ -z cvl_0_1 ]] 00:24:38.181 15:25:39 -- target/device_removal.sh@166 -- # [[ cvl_0_1 != \c\v\l\_\0\_\1 ]] 00:24:38.181 15:25:39 -- target/device_removal.sh@171 -- # break 00:24:38.181 15:25:39 -- target/device_removal.sh@175 -- # [[ -z cvl_0_1 ]] 00:24:38.181 15:25:39 -- target/device_removal.sh@179 -- # ip link set cvl_0_1 up 00:24:38.181 15:25:39 -- target/device_removal.sh@180 -- # get_ip_address cvl_0_1 00:24:38.181 15:25:39 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:24:38.181 15:25:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:24:38.181 15:25:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:38.181 15:25:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:38.181 15:25:39 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:24:38.181 15:25:39 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev cvl_0_1 00:24:38.181 15:25:39 -- target/device_removal.sh@186 -- # seq 1 10 00:24:38.181 [2024-04-24 15:25:39.050144] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:38.181 [2024-04-24 15:25:39.050182] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:24:38.181 [2024-04-24 15:25:39.050201] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:38.181 15:25:39 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:24:38.181 15:25:39 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:38.181 15:25:39 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:38.181 15:25:39 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:38.181 15:25:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:38.181 15:25:39 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:38.181 15:25:39 -- common/autotest_common.sh@10 -- # set +x 00:24:38.181 15:25:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:38.181 15:25:39 -- target/device_removal.sh@187 -- # ib_count=2 00:24:38.181 15:25:39 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:24:38.181 15:25:39 -- target/device_removal.sh@189 -- # break 00:24:38.181 15:25:39 -- target/device_removal.sh@200 -- # stop_bdevperf 00:24:38.181 15:25:39 -- target/device_removal.sh@116 -- # wait 715585 00:25:59.700 0 00:25:59.700 15:27:00 -- target/device_removal.sh@118 -- # killprocess 715398 00:25:59.700 15:27:00 -- common/autotest_common.sh@936 -- # '[' -z 715398 ']' 00:25:59.700 15:27:00 -- common/autotest_common.sh@940 -- # kill -0 715398 00:25:59.700 15:27:00 -- common/autotest_common.sh@941 -- # uname 00:25:59.700 15:27:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.700 15:27:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 715398 00:25:59.700 15:27:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:25:59.700 15:27:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:25:59.700 15:27:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 715398' 00:25:59.700 killing process with pid 715398 00:25:59.700 15:27:01 -- common/autotest_common.sh@955 -- # kill 715398 00:25:59.700 15:27:01 -- common/autotest_common.sh@960 -- # wait 715398 00:25:59.700 15:27:01 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:25:59.700 15:27:01 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:25:59.700 [2024-04-24 15:25:29.603193] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:25:59.700 [2024-04-24 15:25:29.603252] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid715398 ] 00:25:59.700 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.700 [2024-04-24 15:25:29.679361] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.700 [2024-04-24 15:25:29.763356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:59.700 Running I/O for 90 seconds... 00:25:59.700 [2024-04-24 15:25:35.782348] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:59.700 [2024-04-24 15:25:35.782387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.700 [2024-04-24 15:25:35.782401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.782413] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.700 [2024-04-24 15:25:35.782424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.782435] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.700 [2024-04-24 15:25:35.782445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.782457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.700 [2024-04-24 15:25:35.782467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:16 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.783274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.700 [2024-04-24 15:25:35.783292] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:25:59.700 [2024-04-24 15:25:35.783321] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:25:59.700 [2024-04-24 15:25:35.784849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:208584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.784887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:208592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.784910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:208600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.784931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:208608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.784952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:208616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.784978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:208624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.784988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:208632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:208640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:208648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:208656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:208664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:208672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:208680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:208688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:208696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:208704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:208712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:208720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:208728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:208736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:208744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:208752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:208760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.700 [2024-04-24 15:25:35.785357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:208768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0xa4e20006 00:25:59.700 [2024-04-24 15:25:35.785366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:208776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:208784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:208792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:208800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:208808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:208816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:208824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:208832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:208840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:208848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:208856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:208864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:208872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:208880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:208888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0xa4e20006 00:25:59.701 [2024-04-24 15:25:35.785699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:208896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:208904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:208912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:208920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:208928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:208936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:208944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:208952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:208960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:208968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:208976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:208984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:208992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.785986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:209000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.785997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:209008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:209016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:209024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:209032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:209040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:209048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.701 [2024-04-24 15:25:35.786139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:209056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.701 [2024-04-24 15:25:35.786148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:209064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:209072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:209080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:209088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:209096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:209104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:209112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:209120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:209128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:209136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:209144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:209152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:209160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:209168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:209176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:209184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:209192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:209200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:209208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:209216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:209224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:209232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:209240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:209248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:209256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:209264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:209272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:209280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:209288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:209296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:209304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:209312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:209320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:209328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:209336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:209344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:209352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:209360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.702 [2024-04-24 15:25:35.786943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.702 [2024-04-24 15:25:35.786953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:209368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.786965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.786977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:209376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.786987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.786997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:209384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:209392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:209400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:209408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:209416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:209424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:209432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:209440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:209448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:209456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:209464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:209472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:209480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:209488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:209496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:209504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:209512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:209520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:209528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:209536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:209544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:209552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:209560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:209568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:209576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:209584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.787548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:209592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.703 [2024-04-24 15:25:35.787558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.800551] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.703 [2024-04-24 15:25:35.800568] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.703 [2024-04-24 15:25:35.800577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:209600 len:8 PRP1 0x0 PRP2 0x0 00:25:59.703 [2024-04-24 15:25:35.800589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:35.802269] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:25:59.703 [2024-04-24 15:25:35.802554] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:59.703 [2024-04-24 15:25:35.802570] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:59.703 [2024-04-24 15:25:35.802580] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:59.703 [2024-04-24 15:25:35.802600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.703 [2024-04-24 15:25:35.802610] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:25:59.703 [2024-04-24 15:25:35.802623] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:25:59.703 [2024-04-24 15:25:35.802632] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:25:59.703 [2024-04-24 15:25:35.802642] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:25:59.703 [2024-04-24 15:25:35.802662] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:59.703 [2024-04-24 15:25:35.802672] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:25:59.703 [2024-04-24 15:25:37.604352] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:25:59.703 [2024-04-24 15:25:37.604387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.703 [2024-04-24 15:25:37.604399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:37.604410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.703 [2024-04-24 15:25:37.604420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.703 [2024-04-24 15:25:37.604434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.704 [2024-04-24 15:25:37.604443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.604454] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:59.704 [2024-04-24 15:25:37.604463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32539 cdw0:6 sqhd:f3b9 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.604836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.704 [2024-04-24 15:25:37.604853] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:25:59.704 [2024-04-24 15:25:37.604967] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:25:59.704 [2024-04-24 15:25:37.605749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:167184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:167192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:167200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:167208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:167216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:167224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:167232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:167240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:167248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:167256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.605985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:167264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.605997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:167272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:167280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:167288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:167296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:167304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:167312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:167320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:167328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:167336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:167344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:167352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:167360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:167368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:167376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.704 [2024-04-24 15:25:37.606324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:167384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0xdf5fce38 00:25:59.704 [2024-04-24 15:25:37.606334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:167392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:167400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:167408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:167416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:167424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:167432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:167440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:167448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:167456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:167464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:167472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:167480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:167488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:167496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:167504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:167512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:167520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:167528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:167536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:167544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:167552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:167560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:167568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:167576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:167584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:167592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:167600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:167608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:167616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:167624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.606979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.606989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:167632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.607002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.607013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:167640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.607022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.607033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:167648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.607043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.607055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:167656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.607064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.705 [2024-04-24 15:25:37.607075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:167664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0xdf5fce38 00:25:59.705 [2024-04-24 15:25:37.607085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:167672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:167680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:167688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:167696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:167704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:167712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:167720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:167728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:167736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:167744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:167752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:167760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:167768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:167776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:167784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:167792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:167800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:167808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:167816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:167824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:167832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:167840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:167848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:167856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:167864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:167872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:167880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:167888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:167896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:167904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:167912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:167920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:167928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0xdf5fce38 00:25:59.706 [2024-04-24 15:25:37.607813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:167936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.706 [2024-04-24 15:25:37.607833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:167944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.706 [2024-04-24 15:25:37.607854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:167952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.706 [2024-04-24 15:25:37.607874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.706 [2024-04-24 15:25:37.607885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:167960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.607907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:167968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.607928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:167976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.607949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:167984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.607969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:167992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.607988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:168000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.607997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.608008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:168008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.608018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.608028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:168016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.608037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.608048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:168024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.608057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.608068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:168032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.608077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.608087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:168040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.608096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:168048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:168056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:168064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:168072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:168080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:168088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:168096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:168104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:168112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:168120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:168128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:168136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:168144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:168152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:168160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:168168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:168176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:168184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.621539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:168192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:59.707 [2024-04-24 15:25:37.621548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32539 cdw0:5de1b050 sqhd:b530 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.634519] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:59.707 [2024-04-24 15:25:37.634534] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:59.707 [2024-04-24 15:25:37.634543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:168200 len:8 PRP1 0x0 PRP2 0x0 00:25:59.707 [2024-04-24 15:25:37.634553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:59.707 [2024-04-24 15:25:37.634605] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:25:59.707 [2024-04-24 15:25:37.634836] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:25:59.707 [2024-04-24 15:25:37.634850] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:59.707 [2024-04-24 15:25:37.634859] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:59.707 [2024-04-24 15:25:37.634877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.707 [2024-04-24 15:25:37.634887] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:25:59.707 [2024-04-24 15:25:37.634902] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:25:59.707 [2024-04-24 15:25:37.634912] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:25:59.707 [2024-04-24 15:25:37.634922] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:25:59.707 [2024-04-24 15:25:37.634945] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:59.707 [2024-04-24 15:25:37.634955] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:25:59.707 [2024-04-24 15:25:37.721893] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -101) 00:25:59.707 [2024-04-24 15:25:37.721914] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:59.707 [2024-04-24 15:25:37.721922] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:25:59.707 [2024-04-24 15:25:37.721938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.707 [2024-04-24 15:25:37.721947] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] in failed state. 00:25:59.707 [2024-04-24 15:25:37.721958] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] Ctrlr is in error state 00:25:59.708 [2024-04-24 15:25:37.721967] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_0] controller reinitialization failed 00:25:59.708 [2024-04-24 15:25:37.721976] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] already in failed state 00:25:59.708 [2024-04-24 15:25:37.721994] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:59.708 [2024-04-24 15:25:37.722003] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_0] resetting controller 00:25:59.708 [2024-04-24 15:25:38.776991] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.708 [2024-04-24 15:25:39.640057] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:25:59.708 [2024-04-24 15:25:39.640106] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:25:59.708 [2024-04-24 15:25:39.640136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:25:59.708 [2024-04-24 15:25:39.640148] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] in failed state. 00:25:59.708 [2024-04-24 15:25:39.640161] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] Ctrlr is in error state 00:25:59.708 [2024-04-24 15:25:39.640171] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_cvl_0_1] controller reinitialization failed 00:25:59.708 [2024-04-24 15:25:39.640181] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] already in failed state 00:25:59.708 [2024-04-24 15:25:39.640205] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:59.708 [2024-04-24 15:25:39.640215] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_cvl_0_1] resetting controller 00:25:59.708 [2024-04-24 15:25:40.699343] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:59.708 00:25:59.708 Latency(us) 00:25:59.708 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.708 Job: Nvme_cvl_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:25:59.708 Verification LBA range: start 0x0 length 0x8000 00:25:59.708 Nvme_cvl_0_0n1 : 90.01 11656.82 45.53 0.00 0.00 10960.31 2137.04 3034487.76 00:25:59.708 Job: Nvme_cvl_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:25:59.708 Verification LBA range: start 0x0 length 0x8000 00:25:59.708 Nvme_cvl_0_1n1 : 90.01 11326.50 44.24 0.00 0.00 11280.34 2393.49 4055709.61 00:25:59.708 =================================================================================================================== 00:25:59.708 Total : 22983.32 89.78 0.00 0.00 11118.02 2137.04 4055709.61 00:25:59.708 Received shutdown signal, test time was about 90.000000 seconds 00:25:59.708 00:25:59.708 Latency(us) 00:25:59.708 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:59.708 =================================================================================================================== 00:25:59.708 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:59.708 15:27:01 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:25:59.708 15:27:01 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/try.txt 00:25:59.708 15:27:01 -- target/device_removal.sh@202 -- # killprocess 715189 00:25:59.708 15:27:01 -- common/autotest_common.sh@936 -- # '[' -z 715189 ']' 00:25:59.708 15:27:01 -- common/autotest_common.sh@940 -- # kill -0 715189 00:25:59.708 15:27:01 -- common/autotest_common.sh@941 -- # uname 00:25:59.708 15:27:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.708 15:27:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 715189 00:25:59.708 15:27:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.708 15:27:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.708 15:27:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 715189' 00:25:59.708 killing process with pid 715189 00:25:59.708 15:27:01 -- common/autotest_common.sh@955 -- # kill 715189 00:25:59.708 15:27:01 -- common/autotest_common.sh@960 -- # wait 715189 00:25:59.708 [2024-04-24 15:27:01.360038] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:25:59.708 15:27:01 -- target/device_removal.sh@203 -- # nvmfpid= 00:25:59.708 15:27:01 -- target/device_removal.sh@205 -- # return 0 00:25:59.708 00:25:59.708 real 1m33.258s 00:25:59.708 user 4m36.674s 00:25:59.708 sys 0m2.107s 00:25:59.708 15:27:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:59.708 15:27:01 -- common/autotest_common.sh@10 -- # set +x 00:25:59.708 ************************************ 00:25:59.708 END TEST nvmf_device_removal_pci_remove 00:25:59.708 ************************************ 00:25:59.708 15:27:01 -- target/device_removal.sh@317 -- # nvmftestfini 00:25:59.708 15:27:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:25:59.708 15:27:01 -- nvmf/common.sh@117 -- # sync 00:25:59.708 15:27:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:25:59.708 15:27:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:25:59.708 15:27:01 -- nvmf/common.sh@120 -- # set +e 00:25:59.708 15:27:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:25:59.708 15:27:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:25:59.708 rmmod nvme_rdma 00:25:59.708 rmmod nvme_fabrics 00:25:59.708 15:27:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:25:59.708 15:27:01 -- nvmf/common.sh@124 -- # set -e 00:25:59.708 15:27:01 -- nvmf/common.sh@125 -- # return 0 00:25:59.708 15:27:01 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:25:59.708 15:27:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:25:59.708 15:27:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:25:59.708 15:27:01 -- target/device_removal.sh@318 -- # clean_bond_device 00:25:59.708 15:27:01 -- target/device_removal.sh@240 -- # ip link 00:25:59.708 15:27:01 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:25:59.708 00:25:59.708 real 3m14.089s 00:25:59.708 user 9m15.559s 00:25:59.708 sys 0m9.704s 00:25:59.708 15:27:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:25:59.708 15:27:01 -- common/autotest_common.sh@10 -- # set +x 00:25:59.708 ************************************ 00:25:59.708 END TEST nvmf_device_removal 00:25:59.708 ************************************ 00:25:59.708 15:27:01 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:25:59.708 15:27:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:59.708 15:27:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:59.708 15:27:01 -- common/autotest_common.sh@10 -- # set +x 00:25:59.708 ************************************ 00:25:59.708 START TEST nvmf_srq_overwhelm 00:25:59.708 ************************************ 00:25:59.708 15:27:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:25:59.708 * Looking for test storage... 00:25:59.708 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:25:59.708 15:27:02 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:25:59.708 15:27:02 -- nvmf/common.sh@7 -- # uname -s 00:25:59.708 15:27:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:59.708 15:27:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:59.708 15:27:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:59.708 15:27:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:59.708 15:27:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:59.708 15:27:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:59.708 15:27:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:59.708 15:27:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:59.708 15:27:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:59.708 15:27:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:59.708 15:27:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:25:59.708 15:27:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:25:59.708 15:27:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:59.708 15:27:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:59.708 15:27:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:59.708 15:27:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:25:59.708 15:27:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:25:59.708 15:27:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:59.708 15:27:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:59.708 15:27:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:59.708 15:27:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.708 15:27:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.708 15:27:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.708 15:27:02 -- paths/export.sh@5 -- # export PATH 00:25:59.708 15:27:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.709 15:27:02 -- nvmf/common.sh@47 -- # : 0 00:25:59.709 15:27:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:25:59.709 15:27:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:25:59.709 15:27:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:25:59.709 15:27:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:59.709 15:27:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:59.709 15:27:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:25:59.709 15:27:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:25:59.709 15:27:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:25:59.709 15:27:02 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:59.709 15:27:02 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:59.709 15:27:02 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:25:59.709 15:27:02 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:25:59.709 15:27:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:25:59.709 15:27:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:59.709 15:27:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:25:59.709 15:27:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:25:59.709 15:27:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:25:59.709 15:27:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:59.709 15:27:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:59.709 15:27:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:59.709 15:27:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:25:59.709 15:27:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:25:59.709 15:27:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:25:59.709 15:27:02 -- common/autotest_common.sh@10 -- # set +x 00:26:04.989 15:27:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:04.989 15:27:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:04.989 15:27:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:04.989 15:27:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:04.989 15:27:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:04.989 15:27:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:04.989 15:27:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:04.989 15:27:08 -- nvmf/common.sh@295 -- # net_devs=() 00:26:04.989 15:27:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:04.989 15:27:08 -- nvmf/common.sh@296 -- # e810=() 00:26:04.989 15:27:08 -- nvmf/common.sh@296 -- # local -ga e810 00:26:04.989 15:27:08 -- nvmf/common.sh@297 -- # x722=() 00:26:04.989 15:27:08 -- nvmf/common.sh@297 -- # local -ga x722 00:26:04.989 15:27:08 -- nvmf/common.sh@298 -- # mlx=() 00:26:04.989 15:27:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:04.989 15:27:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:04.989 15:27:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:26:04.989 Found 0000:18:00.0 (0x8086 - 0x1592) 00:26:04.989 15:27:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:04.989 15:27:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:26:04.989 Found 0000:18:00.1 (0x8086 - 0x1592) 00:26:04.989 15:27:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:04.989 15:27:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@377 -- # modinfo irdma 00:26:04.989 15:27:08 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:26:04.989 15:27:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.989 15:27:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.989 15:27:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:26:04.989 Found net devices under 0000:18:00.0: cvl_0_0 00:26:04.989 15:27:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:04.989 15:27:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:04.989 15:27:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:26:04.989 Found net devices under 0000:18:00.1: cvl_0_1 00:26:04.989 15:27:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:04.989 15:27:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:04.989 15:27:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:04.989 15:27:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:04.989 15:27:08 -- nvmf/common.sh@58 -- # uname 00:26:04.989 15:27:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:04.989 15:27:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:04.989 15:27:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:04.989 15:27:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:04.989 15:27:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:04.989 15:27:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:04.989 15:27:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:04.989 15:27:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:04.989 15:27:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:04.989 15:27:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:04.989 15:27:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:04.989 15:27:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:04.989 15:27:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:04.989 15:27:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:04.989 15:27:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:04.989 15:27:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:04.989 15:27:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:04.989 15:27:08 -- nvmf/common.sh@105 -- # continue 2 00:26:04.989 15:27:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:04.989 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:04.989 15:27:08 -- nvmf/common.sh@105 -- # continue 2 00:26:04.989 15:27:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:04.989 15:27:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:26:04.989 15:27:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:04.989 15:27:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:04.989 15:27:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:04.989 15:27:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:04.989 15:27:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:04.989 15:27:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:04.989 15:27:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:26:04.989 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:04.989 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:26:04.989 altname enp24s0f0np0 00:26:04.989 altname ens785f0np0 00:26:04.989 inet 192.168.100.8/24 scope global cvl_0_0 00:26:04.989 valid_lft forever preferred_lft forever 00:26:04.989 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:26:04.989 valid_lft forever preferred_lft forever 00:26:04.989 15:27:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:05.249 15:27:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:26:05.249 15:27:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:05.249 15:27:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:05.249 15:27:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:05.249 15:27:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:05.249 15:27:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:05.249 15:27:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:05.249 15:27:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:26:05.249 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:05.249 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:26:05.249 altname enp24s0f1np1 00:26:05.249 altname ens785f1np1 00:26:05.249 inet 192.168.100.9/24 scope global cvl_0_1 00:26:05.249 valid_lft forever preferred_lft forever 00:26:05.249 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:26:05.249 valid_lft forever preferred_lft forever 00:26:05.249 15:27:08 -- nvmf/common.sh@411 -- # return 0 00:26:05.249 15:27:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:05.249 15:27:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:05.249 15:27:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:05.249 15:27:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:05.249 15:27:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:05.249 15:27:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:05.249 15:27:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:05.249 15:27:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:05.249 15:27:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:05.249 15:27:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:05.250 15:27:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:05.250 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:05.250 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:05.250 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:05.250 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:05.250 15:27:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:05.250 15:27:08 -- nvmf/common.sh@105 -- # continue 2 00:26:05.250 15:27:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:05.250 15:27:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:05.250 15:27:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:05.250 15:27:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:05.250 15:27:08 -- nvmf/common.sh@105 -- # continue 2 00:26:05.250 15:27:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:05.250 15:27:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:26:05.250 15:27:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:05.250 15:27:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:05.250 15:27:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:26:05.250 15:27:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:05.250 15:27:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:05.250 15:27:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:05.250 192.168.100.9' 00:26:05.250 15:27:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:05.250 192.168.100.9' 00:26:05.250 15:27:08 -- nvmf/common.sh@446 -- # head -n 1 00:26:05.250 15:27:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:05.250 15:27:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:05.250 192.168.100.9' 00:26:05.250 15:27:08 -- nvmf/common.sh@447 -- # tail -n +2 00:26:05.250 15:27:08 -- nvmf/common.sh@447 -- # head -n 1 00:26:05.250 15:27:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:05.250 15:27:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:05.250 15:27:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:05.250 15:27:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:05.250 15:27:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:05.250 15:27:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:05.250 15:27:09 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:26:05.250 15:27:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:05.250 15:27:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:05.250 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:05.250 15:27:09 -- nvmf/common.sh@470 -- # nvmfpid=731080 00:26:05.250 15:27:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:05.250 15:27:09 -- nvmf/common.sh@471 -- # waitforlisten 731080 00:26:05.250 15:27:09 -- common/autotest_common.sh@817 -- # '[' -z 731080 ']' 00:26:05.250 15:27:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.250 15:27:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:05.250 15:27:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.250 15:27:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:05.250 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:05.250 [2024-04-24 15:27:09.073332] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:05.250 [2024-04-24 15:27:09.073386] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.250 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.250 [2024-04-24 15:27:09.152390] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:05.510 [2024-04-24 15:27:09.234013] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.510 [2024-04-24 15:27:09.234049] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.510 [2024-04-24 15:27:09.234061] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:05.510 [2024-04-24 15:27:09.234070] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:05.510 [2024-04-24 15:27:09.234078] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.510 [2024-04-24 15:27:09.234175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:05.510 [2024-04-24 15:27:09.234130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:05.510 [2024-04-24 15:27:09.234150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:05.510 [2024-04-24 15:27:09.234173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:06.079 15:27:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:06.080 15:27:09 -- common/autotest_common.sh@850 -- # return 0 00:26:06.080 15:27:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:06.080 15:27:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:06.080 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.080 15:27:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:06.080 15:27:09 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:26:06.080 15:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.080 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.080 [2024-04-24 15:27:09.946969] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x113f910/0x113ef50) succeed. 00:26:06.080 [2024-04-24 15:27:09.957531] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1140c80/0x113f4d0) succeed. 00:26:06.080 [2024-04-24 15:27:09.957557] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:26:06.080 15:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.080 15:27:09 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:26:06.080 15:27:09 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:06.080 15:27:09 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:26:06.080 15:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.080 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.080 15:27:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.080 15:27:09 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:06.080 15:27:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.080 15:27:09 -- common/autotest_common.sh@10 -- # set +x 00:26:06.339 Malloc0 00:26:06.339 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.339 15:27:10 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:26:06.339 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.339 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.339 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.339 15:27:10 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:26:06.339 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.339 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.339 [2024-04-24 15:27:10.027548] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:06.339 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.339 15:27:10 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:26:06.339 15:27:10 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:26:06.339 15:27:10 -- common/autotest_common.sh@1221 -- # local i=0 00:26:06.339 15:27:10 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:06.339 15:27:10 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:26:06.598 15:27:10 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:06.598 15:27:10 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:26:06.598 15:27:10 -- common/autotest_common.sh@1232 -- # return 0 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:06.598 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.598 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.598 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:06.598 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.598 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.598 Malloc1 00:26:06.598 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:06.598 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.598 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.598 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:26:06.598 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.598 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.598 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.598 15:27:10 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:26:06.858 15:27:10 -- common/autotest_common.sh@1221 -- # local i=0 00:26:06.858 15:27:10 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:06.858 15:27:10 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:26:06.858 15:27:10 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:26:06.858 15:27:10 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:06.858 15:27:10 -- common/autotest_common.sh@1232 -- # return 0 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:06.858 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.858 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.858 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:26:06.858 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.858 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.858 Malloc2 00:26:06.858 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:26:06.858 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.858 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.858 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:26:06.858 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:06.858 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:06.858 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:06.858 15:27:10 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:26:07.118 15:27:10 -- common/autotest_common.sh@1221 -- # local i=0 00:26:07.118 15:27:10 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:07.118 15:27:10 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:26:07.118 15:27:10 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:07.118 15:27:10 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:26:07.118 15:27:10 -- common/autotest_common.sh@1232 -- # return 0 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:26:07.118 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.118 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:07.118 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:26:07.118 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.118 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:07.118 Malloc3 00:26:07.118 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:26:07.118 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.118 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:07.118 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:26:07.118 15:27:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.118 15:27:10 -- common/autotest_common.sh@10 -- # set +x 00:26:07.118 15:27:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.118 15:27:10 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:26:07.378 15:27:11 -- common/autotest_common.sh@1221 -- # local i=0 00:26:07.378 15:27:11 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:07.378 15:27:11 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:26:07.378 15:27:11 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:26:07.378 15:27:11 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:07.378 15:27:11 -- common/autotest_common.sh@1232 -- # return 0 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:26:07.378 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.378 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.378 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:26:07.378 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.378 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.378 Malloc4 00:26:07.378 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:26:07.378 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.378 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.378 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:26:07.378 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.378 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.378 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.378 15:27:11 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:26:07.638 15:27:11 -- common/autotest_common.sh@1221 -- # local i=0 00:26:07.638 15:27:11 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:07.638 15:27:11 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:26:07.638 15:27:11 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:26:07.638 15:27:11 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:07.638 15:27:11 -- common/autotest_common.sh@1232 -- # return 0 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:26:07.638 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.638 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.638 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:26:07.638 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.638 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.638 Malloc5 00:26:07.638 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:26:07.638 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.638 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.638 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:26:07.638 15:27:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:07.638 15:27:11 -- common/autotest_common.sh@10 -- # set +x 00:26:07.638 15:27:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:07.638 15:27:11 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:26:07.897 15:27:11 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:26:07.897 15:27:11 -- common/autotest_common.sh@1221 -- # local i=0 00:26:07.897 15:27:11 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:26:07.897 15:27:11 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:07.897 15:27:11 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:26:07.897 15:27:11 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:07.897 15:27:11 -- common/autotest_common.sh@1232 -- # return 0 00:26:07.897 15:27:11 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:26:07.897 [global] 00:26:07.897 thread=1 00:26:07.897 invalidate=1 00:26:07.897 rw=read 00:26:07.897 time_based=1 00:26:07.897 runtime=10 00:26:07.897 ioengine=libaio 00:26:07.897 direct=1 00:26:07.897 bs=1048576 00:26:07.897 iodepth=128 00:26:07.897 norandommap=1 00:26:07.897 numjobs=13 00:26:07.897 00:26:07.897 [job0] 00:26:07.897 filename=/dev/nvme0n1 00:26:07.897 [job1] 00:26:07.897 filename=/dev/nvme1n1 00:26:07.897 [job2] 00:26:07.897 filename=/dev/nvme2n1 00:26:07.897 [job3] 00:26:07.897 filename=/dev/nvme3n1 00:26:07.897 [job4] 00:26:07.897 filename=/dev/nvme4n1 00:26:07.897 [job5] 00:26:07.897 filename=/dev/nvme5n1 00:26:08.156 Could not set queue depth (nvme0n1) 00:26:08.156 Could not set queue depth (nvme1n1) 00:26:08.156 Could not set queue depth (nvme2n1) 00:26:08.156 Could not set queue depth (nvme3n1) 00:26:08.156 Could not set queue depth (nvme4n1) 00:26:08.156 Could not set queue depth (nvme5n1) 00:26:08.416 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:08.416 ... 00:26:08.416 fio-3.35 00:26:08.416 Starting 78 threads 00:26:20.631 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731704: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=77, BW=77.3MiB/s (81.1MB/s)(781MiB/10104msec) 00:26:20.631 slat (usec): min=38, max=106252, avg=12800.94, stdev=17240.19 00:26:20.631 clat (msec): min=103, max=2428, avg=1487.29, stdev=500.50 00:26:20.631 lat (msec): min=105, max=2447, avg=1500.09, stdev=501.33 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 218], 5.00th=[ 726], 10.00th=[ 776], 20.00th=[ 1062], 00:26:20.631 | 30.00th=[ 1351], 40.00th=[ 1401], 50.00th=[ 1469], 60.00th=[ 1552], 00:26:20.631 | 70.00th=[ 1670], 80.00th=[ 1989], 90.00th=[ 2198], 95.00th=[ 2265], 00:26:20.631 | 99.00th=[ 2366], 99.50th=[ 2400], 99.90th=[ 2433], 99.95th=[ 2433], 00:26:20.631 | 99.99th=[ 2433] 00:26:20.631 bw ( KiB/s): min=36864, max=169984, per=1.67%, avg=83712.00, stdev=35980.16, samples=16 00:26:20.631 iops : min= 36, max= 166, avg=81.75, stdev=35.14, samples=16 00:26:20.631 lat (msec) : 250=1.54%, 500=1.79%, 750=4.61%, 1000=10.76%, 2000=62.87% 00:26:20.631 lat (msec) : >=2000=18.44% 00:26:20.631 cpu : usr=0.01%, sys=1.25%, ctx=1311, majf=0, minf=32769 00:26:20.631 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.1%, >=64=91.9% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=781,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731705: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=64, BW=64.2MiB/s (67.3MB/s)(648MiB/10099msec) 00:26:20.631 slat (usec): min=60, max=119770, avg=15434.20, stdev=25170.81 00:26:20.631 clat (msec): min=94, max=3140, avg=1823.36, stdev=663.89 00:26:20.631 lat (msec): min=131, max=3167, avg=1838.80, stdev=664.65 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 146], 5.00th=[ 718], 10.00th=[ 1183], 20.00th=[ 1284], 00:26:20.631 | 30.00th=[ 1418], 40.00th=[ 1603], 50.00th=[ 1804], 60.00th=[ 1972], 00:26:20.631 | 70.00th=[ 2165], 80.00th=[ 2299], 90.00th=[ 2836], 95.00th=[ 3004], 00:26:20.631 | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3138], 99.95th=[ 3138], 00:26:20.631 | 99.99th=[ 3138] 00:26:20.631 bw ( KiB/s): min=24526, max=122634, per=1.25%, avg=62747.76, stdev=27013.79, samples=17 00:26:20.631 iops : min= 23, max= 119, avg=61.18, stdev=26.36, samples=17 00:26:20.631 lat (msec) : 100=0.15%, 250=1.54%, 500=1.85%, 750=1.85%, 1000=2.16% 00:26:20.631 lat (msec) : 2000=54.32%, >=2000=38.12% 00:26:20.631 cpu : usr=0.01%, sys=1.22%, ctx=1157, majf=0, minf=32769 00:26:20.631 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=648,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731706: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=56, BW=56.9MiB/s (59.7MB/s)(574MiB/10086msec) 00:26:20.631 slat (usec): min=40, max=129655, avg=17461.02, stdev=29008.97 00:26:20.631 clat (msec): min=60, max=2672, avg=1944.74, stdev=579.75 00:26:20.631 lat (msec): min=107, max=2689, avg=1962.20, stdev=577.95 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 161], 5.00th=[ 718], 10.00th=[ 1150], 20.00th=[ 1502], 00:26:20.631 | 30.00th=[ 1754], 40.00th=[ 2005], 50.00th=[ 2089], 60.00th=[ 2232], 00:26:20.631 | 70.00th=[ 2333], 80.00th=[ 2467], 90.00th=[ 2534], 95.00th=[ 2601], 00:26:20.631 | 99.00th=[ 2601], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], 00:26:20.631 | 99.99th=[ 2668] 00:26:20.631 bw ( KiB/s): min=26624, max=124928, per=1.14%, avg=57088.00, stdev=24620.07, samples=16 00:26:20.631 iops : min= 26, max= 122, avg=55.69, stdev=24.08, samples=16 00:26:20.631 lat (msec) : 100=0.17%, 250=1.57%, 500=2.26%, 750=1.57%, 1000=0.87% 00:26:20.631 lat (msec) : 2000=33.10%, >=2000=60.45% 00:26:20.631 cpu : usr=0.05%, sys=1.02%, ctx=1111, majf=0, minf=32769 00:26:20.631 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.6%, >=64=89.0% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=574,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731707: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=56, BW=56.2MiB/s (58.9MB/s)(570MiB/10139msec) 00:26:20.631 slat (usec): min=52, max=128044, avg=17547.39, stdev=25857.28 00:26:20.631 clat (msec): min=134, max=3513, avg=2139.50, stdev=809.97 00:26:20.631 lat (msec): min=182, max=3529, avg=2157.04, stdev=812.77 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 224], 5.00th=[ 405], 10.00th=[ 860], 20.00th=[ 1720], 00:26:20.631 | 30.00th=[ 1989], 40.00th=[ 2072], 50.00th=[ 2106], 60.00th=[ 2165], 00:26:20.631 | 70.00th=[ 2433], 80.00th=[ 2836], 90.00th=[ 3306], 95.00th=[ 3406], 00:26:20.631 | 99.00th=[ 3473], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], 00:26:20.631 | 99.99th=[ 3507] 00:26:20.631 bw ( KiB/s): min=20480, max=100352, per=1.06%, avg=53368.47, stdev=21326.14, samples=17 00:26:20.631 iops : min= 20, max= 98, avg=52.12, stdev=20.83, samples=17 00:26:20.631 lat (msec) : 250=1.58%, 500=4.91%, 750=2.81%, 1000=1.93%, 2000=20.53% 00:26:20.631 lat (msec) : >=2000=68.25% 00:26:20.631 cpu : usr=0.03%, sys=1.30%, ctx=1161, majf=0, minf=32363 00:26:20.631 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.6%, >=64=88.9% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=570,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731708: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=56, BW=56.7MiB/s (59.5MB/s)(570MiB/10053msec) 00:26:20.631 slat (usec): min=82, max=131099, avg=17580.01, stdev=30651.96 00:26:20.631 clat (msec): min=29, max=3056, avg=2036.60, stdev=697.78 00:26:20.631 lat (msec): min=71, max=3065, avg=2054.18, stdev=698.42 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 82], 5.00th=[ 279], 10.00th=[ 835], 20.00th=[ 1905], 00:26:20.631 | 30.00th=[ 2005], 40.00th=[ 2022], 50.00th=[ 2140], 60.00th=[ 2232], 00:26:20.631 | 70.00th=[ 2333], 80.00th=[ 2534], 90.00th=[ 2836], 95.00th=[ 2937], 00:26:20.631 | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3071], 99.95th=[ 3071], 00:26:20.631 | 99.99th=[ 3071] 00:26:20.631 bw ( KiB/s): min=32768, max=92160, per=1.13%, avg=56576.00, stdev=17279.02, samples=16 00:26:20.631 iops : min= 32, max= 90, avg=55.25, stdev=16.87, samples=16 00:26:20.631 lat (msec) : 50=0.18%, 100=2.63%, 250=1.40%, 500=3.16%, 750=2.11% 00:26:20.631 lat (msec) : 1000=2.11%, 2000=18.25%, >=2000=70.18% 00:26:20.631 cpu : usr=0.06%, sys=1.09%, ctx=1097, majf=0, minf=32769 00:26:20.631 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.6%, >=64=88.9% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=570,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731709: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=64, BW=64.3MiB/s (67.4MB/s)(649MiB/10101msec) 00:26:20.631 slat (usec): min=38, max=170568, avg=15468.29, stdev=24295.53 00:26:20.631 clat (msec): min=59, max=2689, avg=1751.26, stdev=565.85 00:26:20.631 lat (msec): min=100, max=2692, avg=1766.72, stdev=568.10 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 355], 5.00th=[ 625], 10.00th=[ 936], 20.00th=[ 1318], 00:26:20.631 | 30.00th=[ 1502], 40.00th=[ 1720], 50.00th=[ 1804], 60.00th=[ 1871], 00:26:20.631 | 70.00th=[ 2005], 80.00th=[ 2366], 90.00th=[ 2534], 95.00th=[ 2567], 00:26:20.631 | 99.00th=[ 2601], 99.50th=[ 2635], 99.90th=[ 2702], 99.95th=[ 2702], 00:26:20.631 | 99.99th=[ 2702] 00:26:20.631 bw ( KiB/s): min=16384, max=110592, per=1.33%, avg=66688.00, stdev=22334.39, samples=16 00:26:20.631 iops : min= 16, max= 108, avg=65.12, stdev=21.81, samples=16 00:26:20.631 lat (msec) : 100=0.15%, 250=0.31%, 500=2.47%, 750=4.31%, 1000=2.93% 00:26:20.631 lat (msec) : 2000=60.25%, >=2000=29.58% 00:26:20.631 cpu : usr=0.02%, sys=1.15%, ctx=1204, majf=0, minf=32769 00:26:20.631 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:26:20.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.631 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.631 issued rwts: total=649,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.631 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.631 job0: (groupid=0, jobs=1): err= 0: pid=731710: Wed Apr 24 15:27:22 2024 00:26:20.631 read: IOPS=98, BW=98.2MiB/s (103MB/s)(994MiB/10119msec) 00:26:20.631 slat (usec): min=35, max=116187, avg=10091.26, stdev=19500.23 00:26:20.631 clat (msec): min=84, max=2404, avg=1211.39, stdev=428.53 00:26:20.631 lat (msec): min=167, max=2409, avg=1221.48, stdev=430.44 00:26:20.631 clat percentiles (msec): 00:26:20.631 | 1.00th=[ 167], 5.00th=[ 485], 10.00th=[ 760], 20.00th=[ 911], 00:26:20.631 | 30.00th=[ 1003], 40.00th=[ 1083], 50.00th=[ 1183], 60.00th=[ 1301], 00:26:20.631 | 70.00th=[ 1385], 80.00th=[ 1502], 90.00th=[ 1670], 95.00th=[ 2056], 00:26:20.631 | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2400], 99.95th=[ 2400], 00:26:20.631 | 99.99th=[ 2400] 00:26:20.632 bw ( KiB/s): min=40960, max=169984, per=2.08%, avg=104327.53, stdev=34615.67, samples=17 00:26:20.632 iops : min= 40, max= 166, avg=101.88, stdev=33.80, samples=17 00:26:20.632 lat (msec) : 100=0.10%, 250=1.51%, 500=4.53%, 750=3.02%, 1000=19.62% 00:26:20.632 lat (msec) : 2000=64.99%, >=2000=6.24% 00:26:20.632 cpu : usr=0.03%, sys=1.68%, ctx=1229, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.7% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.632 issued rwts: total=994,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731711: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=60, BW=60.8MiB/s (63.8MB/s)(616MiB/10125msec) 00:26:20.632 slat (usec): min=38, max=198564, avg=16314.89, stdev=33213.84 00:26:20.632 clat (msec): min=72, max=2735, avg=1965.55, stdev=666.23 00:26:20.632 lat (msec): min=157, max=2738, avg=1981.86, stdev=668.32 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 188], 5.00th=[ 342], 10.00th=[ 676], 20.00th=[ 1485], 00:26:20.632 | 30.00th=[ 1871], 40.00th=[ 2165], 50.00th=[ 2232], 60.00th=[ 2299], 00:26:20.632 | 70.00th=[ 2366], 80.00th=[ 2467], 90.00th=[ 2567], 95.00th=[ 2601], 00:26:20.632 | 99.00th=[ 2668], 99.50th=[ 2702], 99.90th=[ 2735], 99.95th=[ 2735], 00:26:20.632 | 99.99th=[ 2735] 00:26:20.632 bw ( KiB/s): min=30720, max=120832, per=1.11%, avg=55518.28, stdev=23946.31, samples=18 00:26:20.632 iops : min= 30, max= 118, avg=54.17, stdev=23.41, samples=18 00:26:20.632 lat (msec) : 100=0.16%, 250=2.44%, 500=4.87%, 750=2.92%, 1000=1.14% 00:26:20.632 lat (msec) : 2000=21.27%, >=2000=67.21% 00:26:20.632 cpu : usr=0.01%, sys=1.17%, ctx=1032, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.8% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731712: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=58, BW=58.1MiB/s (60.9MB/s)(589MiB/10134msec) 00:26:20.632 slat (usec): min=43, max=116449, avg=16980.72, stdev=21157.94 00:26:20.632 clat (msec): min=129, max=3062, avg=1960.77, stdev=612.55 00:26:20.632 lat (msec): min=181, max=3073, avg=1977.76, stdev=613.13 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 321], 5.00th=[ 927], 10.00th=[ 1217], 20.00th=[ 1469], 00:26:20.632 | 30.00th=[ 1603], 40.00th=[ 1787], 50.00th=[ 1871], 60.00th=[ 2198], 00:26:20.632 | 70.00th=[ 2333], 80.00th=[ 2601], 90.00th=[ 2769], 95.00th=[ 2903], 00:26:20.632 | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], 00:26:20.632 | 99.99th=[ 3071] 00:26:20.632 bw ( KiB/s): min=32768, max=137216, per=1.18%, avg=59136.00, stdev=25763.32, samples=16 00:26:20.632 iops : min= 32, max= 134, avg=57.75, stdev=25.16, samples=16 00:26:20.632 lat (msec) : 250=0.68%, 500=0.85%, 750=1.87%, 1000=2.55%, 2000=49.41% 00:26:20.632 lat (msec) : >=2000=44.65% 00:26:20.632 cpu : usr=0.00%, sys=1.27%, ctx=1253, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.4%, >=64=89.3% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=589,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731713: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=66, BW=66.5MiB/s (69.7MB/s)(670MiB/10080msec) 00:26:20.632 slat (usec): min=44, max=126273, avg=14948.33, stdev=19440.04 00:26:20.632 clat (msec): min=62, max=3052, avg=1731.87, stdev=701.14 00:26:20.632 lat (msec): min=143, max=3059, avg=1746.82, stdev=703.13 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 153], 5.00th=[ 684], 10.00th=[ 1011], 20.00th=[ 1045], 00:26:20.632 | 30.00th=[ 1150], 40.00th=[ 1469], 50.00th=[ 1821], 60.00th=[ 2056], 00:26:20.632 | 70.00th=[ 2140], 80.00th=[ 2299], 90.00th=[ 2702], 95.00th=[ 2903], 00:26:20.632 | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], 00:26:20.632 | 99.99th=[ 3037] 00:26:20.632 bw ( KiB/s): min= 2048, max=126976, per=1.30%, avg=65295.06, stdev=36253.67, samples=17 00:26:20.632 iops : min= 2, max= 124, avg=63.76, stdev=35.40, samples=17 00:26:20.632 lat (msec) : 100=0.15%, 250=1.79%, 500=1.79%, 750=3.13%, 1000=2.39% 00:26:20.632 lat (msec) : 2000=47.31%, >=2000=43.43% 00:26:20.632 cpu : usr=0.01%, sys=1.23%, ctx=1150, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.6% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=670,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731714: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=58, BW=58.1MiB/s (60.9MB/s)(589MiB/10138msec) 00:26:20.632 slat (usec): min=50, max=130623, avg=17005.49, stdev=25776.54 00:26:20.632 clat (msec): min=118, max=2971, avg=2040.52, stdev=604.97 00:26:20.632 lat (msec): min=144, max=2994, avg=2057.53, stdev=606.10 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 190], 5.00th=[ 625], 10.00th=[ 1099], 20.00th=[ 1787], 00:26:20.632 | 30.00th=[ 1921], 40.00th=[ 2089], 50.00th=[ 2165], 60.00th=[ 2333], 00:26:20.632 | 70.00th=[ 2400], 80.00th=[ 2467], 90.00th=[ 2601], 95.00th=[ 2836], 00:26:20.632 | 99.00th=[ 2903], 99.50th=[ 2937], 99.90th=[ 2970], 99.95th=[ 2970], 00:26:20.632 | 99.99th=[ 2970] 00:26:20.632 bw ( KiB/s): min=28672, max=98304, per=1.11%, avg=55544.18, stdev=17528.91, samples=17 00:26:20.632 iops : min= 28, max= 96, avg=54.24, stdev=17.12, samples=17 00:26:20.632 lat (msec) : 250=1.53%, 500=1.87%, 750=2.72%, 1000=2.72%, 2000=25.13% 00:26:20.632 lat (msec) : >=2000=66.04% 00:26:20.632 cpu : usr=0.02%, sys=1.13%, ctx=1147, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.4%, >=64=89.3% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=589,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731715: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=63, BW=63.1MiB/s (66.2MB/s)(637MiB/10093msec) 00:26:20.632 slat (usec): min=38, max=125962, avg=15725.72, stdev=25766.68 00:26:20.632 clat (msec): min=73, max=2817, avg=1863.16, stdev=578.46 00:26:20.632 lat (msec): min=95, max=2874, avg=1878.88, stdev=579.46 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 174], 5.00th=[ 684], 10.00th=[ 1133], 20.00th=[ 1401], 00:26:20.632 | 30.00th=[ 1670], 40.00th=[ 1838], 50.00th=[ 1955], 60.00th=[ 2056], 00:26:20.632 | 70.00th=[ 2165], 80.00th=[ 2333], 90.00th=[ 2534], 95.00th=[ 2702], 00:26:20.632 | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], 00:26:20.632 | 99.99th=[ 2802] 00:26:20.632 bw ( KiB/s): min=30720, max=79872, per=1.15%, avg=57912.89, stdev=15798.37, samples=18 00:26:20.632 iops : min= 30, max= 78, avg=56.56, stdev=15.43, samples=18 00:26:20.632 lat (msec) : 100=0.31%, 250=1.10%, 500=2.04%, 750=2.67%, 1000=2.83% 00:26:20.632 lat (msec) : 2000=42.70%, >=2000=48.35% 00:26:20.632 cpu : usr=0.00%, sys=1.30%, ctx=1093, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=637,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job0: (groupid=0, jobs=1): err= 0: pid=731717: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=64, BW=64.8MiB/s (68.0MB/s)(655MiB/10102msec) 00:26:20.632 slat (usec): min=46, max=149861, avg=15322.58, stdev=18026.01 00:26:20.632 clat (msec): min=62, max=2993, avg=1773.77, stdev=655.47 00:26:20.632 lat (msec): min=107, max=3009, avg=1789.09, stdev=656.91 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 190], 5.00th=[ 718], 10.00th=[ 927], 20.00th=[ 1083], 00:26:20.632 | 30.00th=[ 1385], 40.00th=[ 1653], 50.00th=[ 1821], 60.00th=[ 2039], 00:26:20.632 | 70.00th=[ 2165], 80.00th=[ 2333], 90.00th=[ 2702], 95.00th=[ 2769], 00:26:20.632 | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 3004], 99.95th=[ 3004], 00:26:20.632 | 99.99th=[ 3004] 00:26:20.632 bw ( KiB/s): min=34816, max=178176, per=1.34%, avg=67451.38, stdev=34892.29, samples=16 00:26:20.632 iops : min= 34, max= 174, avg=65.81, stdev=34.13, samples=16 00:26:20.632 lat (msec) : 100=0.15%, 250=1.22%, 500=1.98%, 750=2.29%, 1000=8.85% 00:26:20.632 lat (msec) : 2000=42.90%, >=2000=42.60% 00:26:20.632 cpu : usr=0.01%, sys=1.21%, ctx=1215, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.9%, >=64=90.4% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.632 issued rwts: total=655,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.632 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.632 job1: (groupid=0, jobs=1): err= 0: pid=731734: Wed Apr 24 15:27:22 2024 00:26:20.632 read: IOPS=62, BW=62.7MiB/s (65.7MB/s)(634MiB/10118msec) 00:26:20.632 slat (usec): min=41, max=130967, avg=15785.40, stdev=24941.85 00:26:20.632 clat (msec): min=107, max=2925, avg=1853.35, stdev=550.60 00:26:20.632 lat (msec): min=124, max=2926, avg=1869.14, stdev=549.94 00:26:20.632 clat percentiles (msec): 00:26:20.632 | 1.00th=[ 249], 5.00th=[ 860], 10.00th=[ 1318], 20.00th=[ 1452], 00:26:20.632 | 30.00th=[ 1603], 40.00th=[ 1770], 50.00th=[ 1838], 60.00th=[ 1938], 00:26:20.632 | 70.00th=[ 2123], 80.00th=[ 2366], 90.00th=[ 2567], 95.00th=[ 2769], 00:26:20.632 | 99.00th=[ 2869], 99.50th=[ 2903], 99.90th=[ 2937], 99.95th=[ 2937], 00:26:20.632 | 99.99th=[ 2937] 00:26:20.632 bw ( KiB/s): min=24576, max=114688, per=1.29%, avg=64768.00, stdev=23253.29, samples=16 00:26:20.632 iops : min= 24, max= 112, avg=63.25, stdev=22.71, samples=16 00:26:20.632 lat (msec) : 250=1.10%, 500=2.21%, 750=1.26%, 1000=2.21%, 2000=57.10% 00:26:20.632 lat (msec) : >=2000=36.12% 00:26:20.632 cpu : usr=0.01%, sys=1.37%, ctx=1175, majf=0, minf=32769 00:26:20.632 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.5%, 32=5.0%, >=64=90.1% 00:26:20.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.632 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.633 issued rwts: total=634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731735: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=82, BW=82.0MiB/s (86.0MB/s)(829MiB/10105msec) 00:26:20.633 slat (usec): min=38, max=101138, avg=12088.55, stdev=17785.86 00:26:20.633 clat (msec): min=79, max=2103, avg=1448.52, stdev=411.35 00:26:20.633 lat (msec): min=117, max=2108, avg=1460.61, stdev=412.43 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 153], 5.00th=[ 472], 10.00th=[ 944], 20.00th=[ 1217], 00:26:20.633 | 30.00th=[ 1284], 40.00th=[ 1502], 50.00th=[ 1586], 60.00th=[ 1636], 00:26:20.633 | 70.00th=[ 1670], 80.00th=[ 1770], 90.00th=[ 1854], 95.00th=[ 1938], 00:26:20.633 | 99.00th=[ 2056], 99.50th=[ 2089], 99.90th=[ 2106], 99.95th=[ 2106], 00:26:20.633 | 99.99th=[ 2106] 00:26:20.633 bw ( KiB/s): min=16384, max=118784, per=1.59%, avg=79751.39, stdev=25550.67, samples=18 00:26:20.633 iops : min= 16, max= 116, avg=77.83, stdev=24.99, samples=18 00:26:20.633 lat (msec) : 100=0.12%, 250=1.81%, 500=3.74%, 750=2.65%, 1000=2.53% 00:26:20.633 lat (msec) : 2000=86.37%, >=2000=2.77% 00:26:20.633 cpu : usr=0.02%, sys=1.30%, ctx=1125, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.4% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.633 issued rwts: total=829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731736: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=47, BW=47.7MiB/s (50.0MB/s)(483MiB/10126msec) 00:26:20.633 slat (usec): min=45, max=152515, avg=20750.41, stdev=30907.19 00:26:20.633 clat (msec): min=101, max=3221, avg=2319.66, stdev=693.93 00:26:20.633 lat (msec): min=148, max=3243, avg=2340.41, stdev=693.68 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 171], 5.00th=[ 667], 10.00th=[ 1250], 20.00th=[ 1972], 00:26:20.633 | 30.00th=[ 2165], 40.00th=[ 2333], 50.00th=[ 2500], 60.00th=[ 2601], 00:26:20.633 | 70.00th=[ 2735], 80.00th=[ 2869], 90.00th=[ 3004], 95.00th=[ 3071], 00:26:20.633 | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.633 | 99.99th=[ 3239] 00:26:20.633 bw ( KiB/s): min=16384, max=63488, per=0.90%, avg=45432.31, stdev=13723.15, samples=16 00:26:20.633 iops : min= 16, max= 62, avg=44.31, stdev=13.34, samples=16 00:26:20.633 lat (msec) : 250=1.86%, 500=1.66%, 750=2.07%, 1000=2.90%, 2000=11.80% 00:26:20.633 lat (msec) : >=2000=79.71% 00:26:20.633 cpu : usr=0.00%, sys=1.02%, ctx=1147, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.633 issued rwts: total=483,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731737: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=61, BW=61.9MiB/s (64.9MB/s)(626MiB/10117msec) 00:26:20.633 slat (usec): min=39, max=134073, avg=15974.58, stdev=28272.70 00:26:20.633 clat (msec): min=114, max=3110, avg=1890.42, stdev=530.10 00:26:20.633 lat (msec): min=126, max=3141, avg=1906.39, stdev=528.99 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 264], 5.00th=[ 936], 10.00th=[ 1385], 20.00th=[ 1502], 00:26:20.633 | 30.00th=[ 1620], 40.00th=[ 1770], 50.00th=[ 1888], 60.00th=[ 2005], 00:26:20.633 | 70.00th=[ 2165], 80.00th=[ 2265], 90.00th=[ 2567], 95.00th=[ 2836], 00:26:20.633 | 99.00th=[ 3037], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], 00:26:20.633 | 99.99th=[ 3104] 00:26:20.633 bw ( KiB/s): min=10240, max=124928, per=1.20%, avg=60114.82, stdev=33070.14, samples=17 00:26:20.633 iops : min= 10, max= 122, avg=58.71, stdev=32.30, samples=17 00:26:20.633 lat (msec) : 250=0.96%, 500=1.44%, 750=1.28%, 1000=1.60%, 2000=54.15% 00:26:20.633 lat (msec) : >=2000=40.58% 00:26:20.633 cpu : usr=0.02%, sys=1.18%, ctx=1085, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.633 issued rwts: total=626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731738: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=83, BW=83.5MiB/s (87.6MB/s)(848MiB/10153msec) 00:26:20.633 slat (usec): min=38, max=134245, avg=11867.64, stdev=19576.80 00:26:20.633 clat (msec): min=86, max=2229, avg=1428.68, stdev=429.25 00:26:20.633 lat (msec): min=167, max=2233, avg=1440.55, stdev=430.79 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 188], 5.00th=[ 439], 10.00th=[ 1003], 20.00th=[ 1217], 00:26:20.633 | 30.00th=[ 1318], 40.00th=[ 1368], 50.00th=[ 1401], 60.00th=[ 1452], 00:26:20.633 | 70.00th=[ 1569], 80.00th=[ 1770], 90.00th=[ 2039], 95.00th=[ 2123], 00:26:20.633 | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2232], 99.95th=[ 2232], 00:26:20.633 | 99.99th=[ 2232] 00:26:20.633 bw ( KiB/s): min=47104, max=129024, per=1.63%, avg=81920.00, stdev=26047.85, samples=18 00:26:20.633 iops : min= 46, max= 126, avg=80.00, stdev=25.44, samples=18 00:26:20.633 lat (msec) : 100=0.12%, 250=1.77%, 500=3.54%, 750=2.83%, 1000=1.42% 00:26:20.633 lat (msec) : 2000=78.89%, >=2000=11.44% 00:26:20.633 cpu : usr=0.02%, sys=1.46%, ctx=1173, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.9%, 32=3.8%, >=64=92.6% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.633 issued rwts: total=848,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731739: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=66, BW=66.7MiB/s (70.0MB/s)(678MiB/10159msec) 00:26:20.633 slat (usec): min=43, max=116533, avg=14866.94, stdev=21045.77 00:26:20.633 clat (msec): min=76, max=2272, avg=1730.19, stdev=483.49 00:26:20.633 lat (msec): min=174, max=2276, avg=1745.06, stdev=484.18 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 197], 5.00th=[ 468], 10.00th=[ 894], 20.00th=[ 1653], 00:26:20.633 | 30.00th=[ 1754], 40.00th=[ 1804], 50.00th=[ 1871], 60.00th=[ 1921], 00:26:20.633 | 70.00th=[ 2005], 80.00th=[ 2056], 90.00th=[ 2106], 95.00th=[ 2165], 00:26:20.633 | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], 00:26:20.633 | 99.99th=[ 2265] 00:26:20.633 bw ( KiB/s): min=22528, max=110592, per=1.32%, avg=66258.82, stdev=20555.91, samples=17 00:26:20.633 iops : min= 22, max= 108, avg=64.71, stdev=20.07, samples=17 00:26:20.633 lat (msec) : 100=0.15%, 250=2.21%, 500=4.57%, 750=1.62%, 1000=1.62% 00:26:20.633 lat (msec) : 2000=60.62%, >=2000=29.20% 00:26:20.633 cpu : usr=0.05%, sys=1.29%, ctx=1183, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.7%, >=64=90.7% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.633 issued rwts: total=678,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731740: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=50, BW=50.7MiB/s (53.1MB/s)(513MiB/10121msec) 00:26:20.633 slat (usec): min=53, max=156384, avg=19491.07, stdev=32784.78 00:26:20.633 clat (msec): min=119, max=3349, avg=2236.90, stdev=667.18 00:26:20.633 lat (msec): min=144, max=3355, avg=2256.39, stdev=664.42 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 186], 5.00th=[ 584], 10.00th=[ 1351], 20.00th=[ 1871], 00:26:20.633 | 30.00th=[ 2039], 40.00th=[ 2232], 50.00th=[ 2400], 60.00th=[ 2534], 00:26:20.633 | 70.00th=[ 2601], 80.00th=[ 2702], 90.00th=[ 2869], 95.00th=[ 3171], 00:26:20.633 | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], 00:26:20.633 | 99.99th=[ 3339] 00:26:20.633 bw ( KiB/s): min= 2048, max=125178, per=0.98%, avg=49416.19, stdev=30497.12, samples=16 00:26:20.633 iops : min= 2, max= 122, avg=48.19, stdev=29.72, samples=16 00:26:20.633 lat (msec) : 250=1.36%, 500=2.14%, 750=2.34%, 1000=1.36%, 2000=18.91% 00:26:20.633 lat (msec) : >=2000=73.88% 00:26:20.633 cpu : usr=0.03%, sys=1.13%, ctx=1112, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.2%, >=64=87.7% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.633 issued rwts: total=513,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731741: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=106, BW=106MiB/s (112MB/s)(1073MiB/10081msec) 00:26:20.633 slat (usec): min=37, max=123821, avg=9341.45, stdev=23671.71 00:26:20.633 clat (msec): min=54, max=1721, avg=1084.37, stdev=307.48 00:26:20.633 lat (msec): min=102, max=1756, avg=1093.71, stdev=308.78 00:26:20.633 clat percentiles (msec): 00:26:20.633 | 1.00th=[ 122], 5.00th=[ 422], 10.00th=[ 760], 20.00th=[ 936], 00:26:20.633 | 30.00th=[ 961], 40.00th=[ 995], 50.00th=[ 1099], 60.00th=[ 1183], 00:26:20.633 | 70.00th=[ 1250], 80.00th=[ 1301], 90.00th=[ 1485], 95.00th=[ 1569], 00:26:20.633 | 99.00th=[ 1670], 99.50th=[ 1703], 99.90th=[ 1720], 99.95th=[ 1720], 00:26:20.633 | 99.99th=[ 1720] 00:26:20.633 bw ( KiB/s): min=42922, max=161792, per=2.27%, avg=113839.65, stdev=35741.21, samples=17 00:26:20.633 iops : min= 41, max= 158, avg=111.12, stdev=35.02, samples=17 00:26:20.633 lat (msec) : 100=0.09%, 250=2.89%, 500=2.98%, 750=3.08%, 1000=31.87% 00:26:20.633 lat (msec) : 2000=59.09% 00:26:20.633 cpu : usr=0.01%, sys=1.34%, ctx=1170, majf=0, minf=32769 00:26:20.633 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=3.0%, >=64=94.1% 00:26:20.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.633 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.633 issued rwts: total=1073,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.633 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.633 job1: (groupid=0, jobs=1): err= 0: pid=731742: Wed Apr 24 15:27:22 2024 00:26:20.633 read: IOPS=38, BW=39.0MiB/s (40.9MB/s)(394MiB/10109msec) 00:26:20.633 slat (usec): min=113, max=204312, avg=25394.60, stdev=32574.24 00:26:20.633 clat (msec): min=101, max=4332, avg=2926.80, stdev=1140.51 00:26:20.633 lat (msec): min=151, max=4389, avg=2952.20, stdev=1142.52 00:26:20.633 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 220], 5.00th=[ 550], 10.00th=[ 860], 20.00th=[ 1838], 00:26:20.634 | 30.00th=[ 2802], 40.00th=[ 3104], 50.00th=[ 3339], 60.00th=[ 3540], 00:26:20.634 | 70.00th=[ 3641], 80.00th=[ 3742], 90.00th=[ 4144], 95.00th=[ 4245], 00:26:20.634 | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4329], 99.95th=[ 4329], 00:26:20.634 | 99.99th=[ 4329] 00:26:20.634 bw ( KiB/s): min= 4096, max=59392, per=0.68%, avg=34176.00, stdev=13032.72, samples=16 00:26:20.634 iops : min= 4, max= 58, avg=33.38, stdev=12.73, samples=16 00:26:20.634 lat (msec) : 250=1.02%, 500=2.28%, 750=5.58%, 1000=3.05%, 2000=9.14% 00:26:20.634 lat (msec) : >=2000=78.93% 00:26:20.634 cpu : usr=0.00%, sys=1.05%, ctx=1126, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.1%, 32=8.1%, >=64=84.0% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:20.634 issued rwts: total=394,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job1: (groupid=0, jobs=1): err= 0: pid=731743: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=57, BW=58.0MiB/s (60.8MB/s)(588MiB/10139msec) 00:26:20.634 slat (usec): min=49, max=142503, avg=17011.69, stdev=23655.40 00:26:20.634 clat (msec): min=133, max=2765, avg=2081.27, stdev=562.23 00:26:20.634 lat (msec): min=147, max=2823, avg=2098.28, stdev=562.44 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 230], 5.00th=[ 751], 10.00th=[ 1334], 20.00th=[ 1603], 00:26:20.634 | 30.00th=[ 2072], 40.00th=[ 2232], 50.00th=[ 2265], 60.00th=[ 2333], 00:26:20.634 | 70.00th=[ 2400], 80.00th=[ 2500], 90.00th=[ 2601], 95.00th=[ 2702], 00:26:20.634 | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], 00:26:20.634 | 99.99th=[ 2769] 00:26:20.634 bw ( KiB/s): min=32768, max=92160, per=1.04%, avg=52451.56, stdev=14086.68, samples=18 00:26:20.634 iops : min= 32, max= 90, avg=51.22, stdev=13.76, samples=18 00:26:20.634 lat (msec) : 250=1.02%, 500=2.04%, 750=1.87%, 1000=1.87%, 2000=20.75% 00:26:20.634 lat (msec) : >=2000=72.45% 00:26:20.634 cpu : usr=0.00%, sys=1.39%, ctx=1176, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.4%, >=64=89.3% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.634 issued rwts: total=588,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job1: (groupid=0, jobs=1): err= 0: pid=731744: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=67, BW=67.1MiB/s (70.3MB/s)(682MiB/10166msec) 00:26:20.634 slat (usec): min=62, max=115447, avg=14713.19, stdev=20107.91 00:26:20.634 clat (msec): min=128, max=2936, avg=1803.57, stdev=665.04 00:26:20.634 lat (msec): min=185, max=2950, avg=1818.29, stdev=666.62 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 326], 5.00th=[ 877], 10.00th=[ 1133], 20.00th=[ 1150], 00:26:20.634 | 30.00th=[ 1234], 40.00th=[ 1502], 50.00th=[ 1770], 60.00th=[ 1989], 00:26:20.634 | 70.00th=[ 2232], 80.00th=[ 2534], 90.00th=[ 2735], 95.00th=[ 2802], 00:26:20.634 | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2937], 99.95th=[ 2937], 00:26:20.634 | 99.99th=[ 2937] 00:26:20.634 bw ( KiB/s): min=28672, max=118784, per=1.33%, avg=66740.71, stdev=30117.26, samples=17 00:26:20.634 iops : min= 28, max= 116, avg=65.18, stdev=29.41, samples=17 00:26:20.634 lat (msec) : 250=0.59%, 500=1.47%, 750=1.61%, 1000=2.64%, 2000=54.25% 00:26:20.634 lat (msec) : >=2000=39.44% 00:26:20.634 cpu : usr=0.02%, sys=1.60%, ctx=1169, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.7%, >=64=90.8% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.634 issued rwts: total=682,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job1: (groupid=0, jobs=1): err= 0: pid=731746: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=37, BW=37.3MiB/s (39.1MB/s)(378MiB/10135msec) 00:26:20.634 slat (usec): min=43, max=249351, avg=26569.17, stdev=38248.30 00:26:20.634 clat (msec): min=89, max=4241, avg=3026.63, stdev=1045.76 00:26:20.634 lat (msec): min=147, max=4293, avg=3053.20, stdev=1045.42 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 207], 5.00th=[ 651], 10.00th=[ 1116], 20.00th=[ 2467], 00:26:20.634 | 30.00th=[ 2970], 40.00th=[ 3138], 50.00th=[ 3306], 60.00th=[ 3473], 00:26:20.634 | 70.00th=[ 3641], 80.00th=[ 3910], 90.00th=[ 4077], 95.00th=[ 4144], 00:26:20.634 | 99.00th=[ 4212], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], 00:26:20.634 | 99.99th=[ 4245] 00:26:20.634 bw ( KiB/s): min=18432, max=69632, per=0.68%, avg=34129.73, stdev=12403.60, samples=15 00:26:20.634 iops : min= 18, max= 68, avg=33.27, stdev=12.16, samples=15 00:26:20.634 lat (msec) : 100=0.26%, 250=1.06%, 500=2.91%, 750=1.59%, 1000=2.91% 00:26:20.634 lat (msec) : 2000=8.20%, >=2000=83.07% 00:26:20.634 cpu : usr=0.01%, sys=0.90%, ctx=1056, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.1%, 16=4.2%, 32=8.5%, >=64=83.3% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:20.634 issued rwts: total=378,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job1: (groupid=0, jobs=1): err= 0: pid=731747: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=48, BW=48.8MiB/s (51.1MB/s)(496MiB/10171msec) 00:26:20.634 slat (usec): min=49, max=132886, avg=20242.45, stdev=31404.42 00:26:20.634 clat (msec): min=128, max=4162, avg=2429.12, stdev=1124.89 00:26:20.634 lat (msec): min=184, max=4173, avg=2449.36, stdev=1129.68 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 218], 5.00th=[ 651], 10.00th=[ 802], 20.00th=[ 1284], 00:26:20.634 | 30.00th=[ 1502], 40.00th=[ 2299], 50.00th=[ 2668], 60.00th=[ 3004], 00:26:20.634 | 70.00th=[ 3205], 80.00th=[ 3507], 90.00th=[ 3910], 95.00th=[ 3977], 00:26:20.634 | 99.00th=[ 4077], 99.50th=[ 4111], 99.90th=[ 4178], 99.95th=[ 4178], 00:26:20.634 | 99.99th=[ 4178] 00:26:20.634 bw ( KiB/s): min=24576, max=129024, per=0.88%, avg=44333.18, stdev=26584.01, samples=17 00:26:20.634 iops : min= 24, max= 126, avg=43.29, stdev=25.96, samples=17 00:26:20.634 lat (msec) : 250=1.41%, 500=1.41%, 750=5.04%, 1000=6.45%, 2000=23.19% 00:26:20.634 lat (msec) : >=2000=62.50% 00:26:20.634 cpu : usr=0.00%, sys=1.25%, ctx=1141, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.5%, >=64=87.3% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.634 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job2: (groupid=0, jobs=1): err= 0: pid=731755: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=70, BW=70.8MiB/s (74.3MB/s)(717MiB/10123msec) 00:26:20.634 slat (usec): min=39, max=115936, avg=13966.88, stdev=24667.15 00:26:20.634 clat (msec): min=105, max=2821, avg=1546.81, stdev=646.20 00:26:20.634 lat (msec): min=128, max=2826, avg=1560.78, stdev=649.10 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 275], 5.00th=[ 810], 10.00th=[ 860], 20.00th=[ 936], 00:26:20.634 | 30.00th=[ 1070], 40.00th=[ 1150], 50.00th=[ 1368], 60.00th=[ 1670], 00:26:20.634 | 70.00th=[ 1955], 80.00th=[ 2299], 90.00th=[ 2500], 95.00th=[ 2668], 00:26:20.634 | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2836], 99.95th=[ 2836], 00:26:20.634 | 99.99th=[ 2836] 00:26:20.634 bw ( KiB/s): min=26624, max=157696, per=1.60%, avg=80418.13, stdev=43709.10, samples=15 00:26:20.634 iops : min= 26, max= 154, avg=78.53, stdev=42.68, samples=15 00:26:20.634 lat (msec) : 250=0.98%, 500=0.84%, 750=0.98%, 1000=22.18%, 2000=47.28% 00:26:20.634 lat (msec) : >=2000=27.75% 00:26:20.634 cpu : usr=0.05%, sys=1.06%, ctx=1231, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.634 issued rwts: total=717,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job2: (groupid=0, jobs=1): err= 0: pid=731756: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=110, BW=110MiB/s (116MB/s)(1121MiB/10155msec) 00:26:20.634 slat (usec): min=38, max=116499, avg=8965.32, stdev=20122.35 00:26:20.634 clat (msec): min=101, max=1886, avg=1096.52, stdev=320.60 00:26:20.634 lat (msec): min=188, max=1890, avg=1105.49, stdev=321.49 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 207], 5.00th=[ 584], 10.00th=[ 810], 20.00th=[ 885], 00:26:20.634 | 30.00th=[ 978], 40.00th=[ 1003], 50.00th=[ 1028], 60.00th=[ 1099], 00:26:20.634 | 70.00th=[ 1167], 80.00th=[ 1385], 90.00th=[ 1485], 95.00th=[ 1754], 00:26:20.634 | 99.00th=[ 1871], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], 00:26:20.634 | 99.99th=[ 1888] 00:26:20.634 bw ( KiB/s): min= 4096, max=167936, per=2.25%, avg=112973.11, stdev=39033.15, samples=18 00:26:20.634 iops : min= 4, max= 164, avg=110.28, stdev=38.17, samples=18 00:26:20.634 lat (msec) : 250=1.43%, 500=2.68%, 750=3.57%, 1000=31.22%, 2000=61.11% 00:26:20.634 cpu : usr=0.00%, sys=1.66%, ctx=1150, majf=0, minf=32769 00:26:20.634 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.9%, >=64=94.4% 00:26:20.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.634 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.634 issued rwts: total=1121,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.634 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.634 job2: (groupid=0, jobs=1): err= 0: pid=731757: Wed Apr 24 15:27:22 2024 00:26:20.634 read: IOPS=41, BW=41.4MiB/s (43.4MB/s)(421MiB/10171msec) 00:26:20.634 slat (usec): min=73, max=138665, avg=23850.89, stdev=25576.45 00:26:20.634 clat (msec): min=127, max=4016, avg=2826.60, stdev=938.20 00:26:20.634 lat (msec): min=178, max=4020, avg=2850.45, stdev=938.30 00:26:20.634 clat percentiles (msec): 00:26:20.634 | 1.00th=[ 257], 5.00th=[ 835], 10.00th=[ 1452], 20.00th=[ 2165], 00:26:20.634 | 30.00th=[ 2433], 40.00th=[ 2601], 50.00th=[ 3004], 60.00th=[ 3406], 00:26:20.634 | 70.00th=[ 3507], 80.00th=[ 3708], 90.00th=[ 3809], 95.00th=[ 3876], 00:26:20.634 | 99.00th=[ 3910], 99.50th=[ 3943], 99.90th=[ 4010], 99.95th=[ 4010], 00:26:20.634 | 99.99th=[ 4010] 00:26:20.634 bw ( KiB/s): min=24576, max=65536, per=0.70%, avg=35297.88, stdev=9399.89, samples=17 00:26:20.634 iops : min= 24, max= 64, avg=34.47, stdev= 9.18, samples=17 00:26:20.634 lat (msec) : 250=0.95%, 500=1.90%, 750=1.66%, 1000=1.90%, 2000=10.21% 00:26:20.634 lat (msec) : >=2000=83.37% 00:26:20.635 cpu : usr=0.00%, sys=1.23%, ctx=1240, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.0% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.635 issued rwts: total=421,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731758: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=91, BW=91.3MiB/s (95.7MB/s)(928MiB/10167msec) 00:26:20.635 slat (usec): min=41, max=96542, avg=10813.60, stdev=14682.71 00:26:20.635 clat (msec): min=127, max=2238, avg=1278.97, stdev=431.39 00:26:20.635 lat (msec): min=168, max=2251, avg=1289.78, stdev=433.35 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 393], 5.00th=[ 802], 10.00th=[ 911], 20.00th=[ 944], 00:26:20.635 | 30.00th=[ 969], 40.00th=[ 1003], 50.00th=[ 1133], 60.00th=[ 1318], 00:26:20.635 | 70.00th=[ 1435], 80.00th=[ 1620], 90.00th=[ 1989], 95.00th=[ 2123], 00:26:20.635 | 99.00th=[ 2198], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], 00:26:20.635 | 99.99th=[ 2232] 00:26:20.635 bw ( KiB/s): min=14336, max=157696, per=1.92%, avg=96376.47, stdev=40467.25, samples=17 00:26:20.635 iops : min= 14, max= 154, avg=94.12, stdev=39.52, samples=17 00:26:20.635 lat (msec) : 250=0.43%, 500=0.97%, 750=2.59%, 1000=35.24%, 2000=51.08% 00:26:20.635 lat (msec) : >=2000=9.70% 00:26:20.635 cpu : usr=0.01%, sys=1.47%, ctx=1227, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.4%, >=64=93.2% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.635 issued rwts: total=928,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731759: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=74, BW=74.9MiB/s (78.5MB/s)(755MiB/10086msec) 00:26:20.635 slat (usec): min=39, max=140537, avg=13270.14, stdev=27080.81 00:26:20.635 clat (msec): min=63, max=2845, avg=1551.76, stdev=579.30 00:26:20.635 lat (msec): min=88, max=2861, avg=1565.03, stdev=580.87 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 113], 5.00th=[ 844], 10.00th=[ 1083], 20.00th=[ 1116], 00:26:20.635 | 30.00th=[ 1183], 40.00th=[ 1267], 50.00th=[ 1318], 60.00th=[ 1670], 00:26:20.635 | 70.00th=[ 1821], 80.00th=[ 1972], 90.00th=[ 2601], 95.00th=[ 2668], 00:26:20.635 | 99.00th=[ 2735], 99.50th=[ 2769], 99.90th=[ 2836], 99.95th=[ 2836], 00:26:20.635 | 99.99th=[ 2836] 00:26:20.635 bw ( KiB/s): min=26624, max=126976, per=1.50%, avg=75535.00, stdev=33627.85, samples=17 00:26:20.635 iops : min= 26, max= 124, avg=73.71, stdev=32.89, samples=17 00:26:20.635 lat (msec) : 100=0.53%, 250=1.19%, 500=1.19%, 750=1.59%, 1000=1.72% 00:26:20.635 lat (msec) : 2000=74.17%, >=2000=19.60% 00:26:20.635 cpu : usr=0.04%, sys=1.06%, ctx=1058, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.7% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.635 issued rwts: total=755,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731760: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=49, BW=49.1MiB/s (51.5MB/s)(496MiB/10106msec) 00:26:20.635 slat (usec): min=71, max=105170, avg=20159.01, stdev=19783.69 00:26:20.635 clat (msec): min=104, max=3126, avg=2325.47, stdev=605.64 00:26:20.635 lat (msec): min=111, max=3163, avg=2345.63, stdev=603.48 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 228], 5.00th=[ 953], 10.00th=[ 1469], 20.00th=[ 2039], 00:26:20.635 | 30.00th=[ 2265], 40.00th=[ 2333], 50.00th=[ 2433], 60.00th=[ 2534], 00:26:20.635 | 70.00th=[ 2668], 80.00th=[ 2769], 90.00th=[ 2970], 95.00th=[ 3071], 00:26:20.635 | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3138], 99.95th=[ 3138], 00:26:20.635 | 99.99th=[ 3138] 00:26:20.635 bw ( KiB/s): min=18468, max=102605, per=0.94%, avg=47255.50, stdev=20853.15, samples=16 00:26:20.635 iops : min= 18, max= 100, avg=46.12, stdev=20.32, samples=16 00:26:20.635 lat (msec) : 250=1.21%, 500=1.21%, 750=1.41%, 1000=1.21%, 2000=13.10% 00:26:20.635 lat (msec) : >=2000=81.85% 00:26:20.635 cpu : usr=0.02%, sys=1.06%, ctx=1166, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.5%, >=64=87.3% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.635 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731761: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=41, BW=41.9MiB/s (43.9MB/s)(423MiB/10106msec) 00:26:20.635 slat (usec): min=421, max=114145, avg=23646.19, stdev=28526.09 00:26:20.635 clat (msec): min=102, max=4361, avg=2838.97, stdev=946.59 00:26:20.635 lat (msec): min=109, max=4382, avg=2862.61, stdev=946.57 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 220], 5.00th=[ 927], 10.00th=[ 1603], 20.00th=[ 2232], 00:26:20.635 | 30.00th=[ 2601], 40.00th=[ 2769], 50.00th=[ 2869], 60.00th=[ 3004], 00:26:20.635 | 70.00th=[ 3406], 80.00th=[ 3641], 90.00th=[ 4111], 95.00th=[ 4212], 00:26:20.635 | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4329], 99.95th=[ 4329], 00:26:20.635 | 99.99th=[ 4329] 00:26:20.635 bw ( KiB/s): min=24576, max=63488, per=0.71%, avg=35652.24, stdev=9639.46, samples=17 00:26:20.635 iops : min= 24, max= 62, avg=34.71, stdev= 9.49, samples=17 00:26:20.635 lat (msec) : 250=1.65%, 500=1.18%, 750=1.42%, 1000=1.65%, 2000=11.35% 00:26:20.635 lat (msec) : >=2000=82.74% 00:26:20.635 cpu : usr=0.04%, sys=1.05%, ctx=1237, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.1% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.635 issued rwts: total=423,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731762: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=59, BW=59.7MiB/s (62.6MB/s)(604MiB/10124msec) 00:26:20.635 slat (usec): min=39, max=99111, avg=16564.26, stdev=17660.99 00:26:20.635 clat (msec): min=116, max=2875, avg=1848.89, stdev=629.58 00:26:20.635 lat (msec): min=129, max=2899, avg=1865.45, stdev=632.20 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 153], 5.00th=[ 625], 10.00th=[ 852], 20.00th=[ 1502], 00:26:20.635 | 30.00th=[ 1636], 40.00th=[ 1754], 50.00th=[ 1938], 60.00th=[ 2089], 00:26:20.635 | 70.00th=[ 2165], 80.00th=[ 2366], 90.00th=[ 2668], 95.00th=[ 2769], 00:26:20.635 | 99.00th=[ 2836], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], 00:26:20.635 | 99.99th=[ 2869] 00:26:20.635 bw ( KiB/s): min=20480, max=129024, per=1.30%, avg=65126.40, stdev=23860.99, samples=15 00:26:20.635 iops : min= 20, max= 126, avg=63.60, stdev=23.30, samples=15 00:26:20.635 lat (msec) : 250=1.66%, 500=1.66%, 750=4.80%, 1000=5.79%, 2000=41.06% 00:26:20.635 lat (msec) : >=2000=45.03% 00:26:20.635 cpu : usr=0.03%, sys=1.14%, ctx=1228, majf=0, minf=32769 00:26:20.635 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:26:20.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.635 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.635 issued rwts: total=604,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.635 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.635 job2: (groupid=0, jobs=1): err= 0: pid=731763: Wed Apr 24 15:27:22 2024 00:26:20.635 read: IOPS=46, BW=46.3MiB/s (48.6MB/s)(468MiB/10107msec) 00:26:20.635 slat (usec): min=122, max=111965, avg=21365.16, stdev=24054.39 00:26:20.635 clat (msec): min=106, max=3865, avg=2389.39, stdev=785.75 00:26:20.635 lat (msec): min=121, max=3890, avg=2410.75, stdev=783.52 00:26:20.635 clat percentiles (msec): 00:26:20.635 | 1.00th=[ 241], 5.00th=[ 961], 10.00th=[ 1502], 20.00th=[ 1687], 00:26:20.635 | 30.00th=[ 1972], 40.00th=[ 2232], 50.00th=[ 2467], 60.00th=[ 2668], 00:26:20.635 | 70.00th=[ 2869], 80.00th=[ 3037], 90.00th=[ 3440], 95.00th=[ 3608], 00:26:20.635 | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3876], 99.95th=[ 3876], 00:26:20.635 | 99.99th=[ 3876] 00:26:20.636 bw ( KiB/s): min=22528, max=90112, per=0.93%, avg=46557.87, stdev=22266.72, samples=15 00:26:20.636 iops : min= 22, max= 88, avg=45.47, stdev=21.74, samples=15 00:26:20.636 lat (msec) : 250=1.07%, 500=1.28%, 750=1.28%, 1000=1.50%, 2000=26.28% 00:26:20.636 lat (msec) : >=2000=68.59% 00:26:20.636 cpu : usr=0.03%, sys=1.15%, ctx=1297, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.5% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.636 issued rwts: total=468,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job2: (groupid=0, jobs=1): err= 0: pid=731764: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=61, BW=61.1MiB/s (64.1MB/s)(616MiB/10078msec) 00:26:20.636 slat (usec): min=42, max=138734, avg=16262.65, stdev=20837.77 00:26:20.636 clat (msec): min=57, max=3693, avg=1915.80, stdev=772.27 00:26:20.636 lat (msec): min=87, max=3721, avg=1932.07, stdev=772.64 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 144], 5.00th=[ 743], 10.00th=[ 1083], 20.00th=[ 1250], 00:26:20.636 | 30.00th=[ 1435], 40.00th=[ 1653], 50.00th=[ 1938], 60.00th=[ 2005], 00:26:20.636 | 70.00th=[ 2232], 80.00th=[ 2366], 90.00th=[ 3239], 95.00th=[ 3406], 00:26:20.636 | 99.00th=[ 3574], 99.50th=[ 3641], 99.90th=[ 3708], 99.95th=[ 3708], 00:26:20.636 | 99.99th=[ 3708] 00:26:20.636 bw ( KiB/s): min=18395, max=159744, per=1.17%, avg=58767.00, stdev=37108.47, samples=17 00:26:20.636 iops : min= 17, max= 156, avg=57.24, stdev=36.23, samples=17 00:26:20.636 lat (msec) : 100=0.32%, 250=1.30%, 500=1.95%, 750=1.46%, 1000=2.27% 00:26:20.636 lat (msec) : 2000=51.95%, >=2000=40.75% 00:26:20.636 cpu : usr=0.02%, sys=1.12%, ctx=1267, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.8% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.636 issued rwts: total=616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job2: (groupid=0, jobs=1): err= 0: pid=731765: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=75, BW=75.6MiB/s (79.2MB/s)(764MiB/10111msec) 00:26:20.636 slat (usec): min=37, max=100633, avg=13105.01, stdev=16691.23 00:26:20.636 clat (msec): min=96, max=3114, avg=1517.54, stdev=679.95 00:26:20.636 lat (msec): min=145, max=3130, avg=1530.65, stdev=682.40 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 180], 5.00th=[ 451], 10.00th=[ 877], 20.00th=[ 1083], 00:26:20.636 | 30.00th=[ 1150], 40.00th=[ 1217], 50.00th=[ 1334], 60.00th=[ 1435], 00:26:20.636 | 70.00th=[ 1687], 80.00th=[ 2089], 90.00th=[ 2735], 95.00th=[ 2903], 00:26:20.636 | 99.00th=[ 3071], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], 00:26:20.636 | 99.99th=[ 3104] 00:26:20.636 bw ( KiB/s): min=20480, max=126976, per=1.62%, avg=81408.00, stdev=35294.59, samples=16 00:26:20.636 iops : min= 20, max= 124, avg=79.50, stdev=34.47, samples=16 00:26:20.636 lat (msec) : 100=0.13%, 250=1.83%, 500=4.06%, 750=3.01%, 1000=1.96% 00:26:20.636 lat (msec) : 2000=64.92%, >=2000=24.08% 00:26:20.636 cpu : usr=0.05%, sys=1.10%, ctx=1140, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.2%, >=64=91.8% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.636 issued rwts: total=764,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job2: (groupid=0, jobs=1): err= 0: pid=731766: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=61, BW=61.3MiB/s (64.3MB/s)(623MiB/10166msec) 00:26:20.636 slat (usec): min=53, max=119380, avg=16113.19, stdev=24719.91 00:26:20.636 clat (msec): min=124, max=3253, avg=1923.82, stdev=773.78 00:26:20.636 lat (msec): min=171, max=3298, avg=1939.94, stdev=775.96 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 266], 5.00th=[ 885], 10.00th=[ 1053], 20.00th=[ 1234], 00:26:20.636 | 30.00th=[ 1351], 40.00th=[ 1502], 50.00th=[ 1703], 60.00th=[ 2299], 00:26:20.636 | 70.00th=[ 2500], 80.00th=[ 2702], 90.00th=[ 3037], 95.00th=[ 3171], 00:26:20.636 | 99.00th=[ 3205], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.636 | 99.99th=[ 3239] 00:26:20.636 bw ( KiB/s): min=28672, max=116736, per=1.12%, avg=56320.00, stdev=24326.26, samples=18 00:26:20.636 iops : min= 28, max= 114, avg=55.00, stdev=23.76, samples=18 00:26:20.636 lat (msec) : 250=0.96%, 500=1.61%, 750=1.77%, 1000=1.28%, 2000=48.48% 00:26:20.636 lat (msec) : >=2000=45.91% 00:26:20.636 cpu : usr=0.01%, sys=1.27%, ctx=1152, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.636 issued rwts: total=623,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job2: (groupid=0, jobs=1): err= 0: pid=731768: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=53, BW=53.7MiB/s (56.3MB/s)(544MiB/10124msec) 00:26:20.636 slat (usec): min=38, max=104265, avg=18411.46, stdev=24135.60 00:26:20.636 clat (msec): min=105, max=3488, avg=2187.39, stdev=666.37 00:26:20.636 lat (msec): min=188, max=3514, avg=2205.80, stdev=665.12 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 279], 5.00th=[ 1070], 10.00th=[ 1452], 20.00th=[ 1670], 00:26:20.636 | 30.00th=[ 1787], 40.00th=[ 2056], 50.00th=[ 2232], 60.00th=[ 2400], 00:26:20.636 | 70.00th=[ 2500], 80.00th=[ 2735], 90.00th=[ 3104], 95.00th=[ 3306], 00:26:20.636 | 99.00th=[ 3440], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], 00:26:20.636 | 99.99th=[ 3473] 00:26:20.636 bw ( KiB/s): min=10219, max=129024, per=1.00%, avg=50114.53, stdev=28158.30, samples=17 00:26:20.636 iops : min= 9, max= 126, avg=48.88, stdev=27.59, samples=17 00:26:20.636 lat (msec) : 250=0.74%, 500=1.65%, 750=0.92%, 1000=1.47%, 2000=33.82% 00:26:20.636 lat (msec) : >=2000=61.40% 00:26:20.636 cpu : usr=0.03%, sys=1.36%, ctx=1224, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=2.9%, 32=5.9%, >=64=88.4% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.636 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job3: (groupid=0, jobs=1): err= 0: pid=731773: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=68, BW=68.2MiB/s (71.5MB/s)(689MiB/10105msec) 00:26:20.636 slat (usec): min=55, max=112723, avg=14528.81, stdev=21651.65 00:26:20.636 clat (msec): min=92, max=3275, avg=1796.72, stdev=945.54 00:26:20.636 lat (msec): min=153, max=3315, avg=1811.24, stdev=951.07 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 190], 5.00th=[ 617], 10.00th=[ 844], 20.00th=[ 961], 00:26:20.636 | 30.00th=[ 1070], 40.00th=[ 1217], 50.00th=[ 1385], 60.00th=[ 1972], 00:26:20.636 | 70.00th=[ 2635], 80.00th=[ 3037], 90.00th=[ 3171], 95.00th=[ 3205], 00:26:20.636 | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], 00:26:20.636 | 99.99th=[ 3272] 00:26:20.636 bw ( KiB/s): min=26624, max=147456, per=1.20%, avg=60469.89, stdev=35018.66, samples=19 00:26:20.636 iops : min= 26, max= 144, avg=59.05, stdev=34.20, samples=19 00:26:20.636 lat (msec) : 100=0.15%, 250=1.31%, 500=2.32%, 750=5.22%, 1000=15.24% 00:26:20.636 lat (msec) : 2000=35.99%, >=2000=39.77% 00:26:20.636 cpu : usr=0.01%, sys=1.37%, ctx=1241, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.636 issued rwts: total=689,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job3: (groupid=0, jobs=1): err= 0: pid=731774: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=50, BW=50.3MiB/s (52.7MB/s)(510MiB/10148msec) 00:26:20.636 slat (usec): min=49, max=188174, avg=19694.50, stdev=23943.55 00:26:20.636 clat (msec): min=101, max=4026, avg=2328.50, stdev=1042.64 00:26:20.636 lat (msec): min=154, max=4052, avg=2348.20, stdev=1045.76 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 222], 5.00th=[ 523], 10.00th=[ 1267], 20.00th=[ 1418], 00:26:20.636 | 30.00th=[ 1670], 40.00th=[ 1938], 50.00th=[ 2072], 60.00th=[ 2467], 00:26:20.636 | 70.00th=[ 2802], 80.00th=[ 3641], 90.00th=[ 3876], 95.00th=[ 3943], 00:26:20.636 | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], 00:26:20.636 | 99.99th=[ 4010] 00:26:20.636 bw ( KiB/s): min= 6144, max=126976, per=0.92%, avg=46019.76, stdev=28855.35, samples=17 00:26:20.636 iops : min= 6, max= 124, avg=44.94, stdev=28.18, samples=17 00:26:20.636 lat (msec) : 250=1.37%, 500=3.53%, 750=1.76%, 1000=1.57%, 2000=35.29% 00:26:20.636 lat (msec) : >=2000=56.47% 00:26:20.636 cpu : usr=0.00%, sys=1.32%, ctx=1186, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.6% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.636 issued rwts: total=510,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.636 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.636 job3: (groupid=0, jobs=1): err= 0: pid=731775: Wed Apr 24 15:27:22 2024 00:26:20.636 read: IOPS=51, BW=51.6MiB/s (54.1MB/s)(521MiB/10100msec) 00:26:20.636 slat (usec): min=43, max=125619, avg=19273.83, stdev=25768.48 00:26:20.636 clat (msec): min=55, max=3581, avg=2271.77, stdev=857.62 00:26:20.636 lat (msec): min=116, max=3621, avg=2291.04, stdev=860.09 00:26:20.636 clat percentiles (msec): 00:26:20.636 | 1.00th=[ 176], 5.00th=[ 567], 10.00th=[ 835], 20.00th=[ 1787], 00:26:20.636 | 30.00th=[ 2123], 40.00th=[ 2165], 50.00th=[ 2265], 60.00th=[ 2467], 00:26:20.636 | 70.00th=[ 2802], 80.00th=[ 3104], 90.00th=[ 3306], 95.00th=[ 3507], 00:26:20.636 | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], 00:26:20.636 | 99.99th=[ 3574] 00:26:20.636 bw ( KiB/s): min= 2048, max=83968, per=0.94%, avg=47340.59, stdev=20583.01, samples=17 00:26:20.636 iops : min= 2, max= 82, avg=46.18, stdev=20.13, samples=17 00:26:20.636 lat (msec) : 100=0.19%, 250=1.54%, 500=2.88%, 750=4.99%, 1000=2.88% 00:26:20.636 lat (msec) : 2000=9.21%, >=2000=78.31% 00:26:20.636 cpu : usr=0.01%, sys=1.04%, ctx=1173, majf=0, minf=32769 00:26:20.636 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.1%, >=64=87.9% 00:26:20.636 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.636 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.637 issued rwts: total=521,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731776: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=64, BW=64.4MiB/s (67.6MB/s)(650MiB/10086msec) 00:26:20.637 slat (usec): min=41, max=112900, avg=15407.20, stdev=24365.72 00:26:20.637 clat (msec): min=68, max=3251, avg=1757.89, stdev=922.43 00:26:20.637 lat (msec): min=85, max=3264, avg=1773.30, stdev=927.79 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 169], 5.00th=[ 305], 10.00th=[ 518], 20.00th=[ 911], 00:26:20.637 | 30.00th=[ 986], 40.00th=[ 1267], 50.00th=[ 1854], 60.00th=[ 2089], 00:26:20.637 | 70.00th=[ 2534], 80.00th=[ 2802], 90.00th=[ 3004], 95.00th=[ 3037], 00:26:20.637 | 99.00th=[ 3171], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.637 | 99.99th=[ 3239] 00:26:20.637 bw ( KiB/s): min= 8192, max=155648, per=1.25%, avg=62885.65, stdev=39842.45, samples=17 00:26:20.637 iops : min= 8, max= 152, avg=61.41, stdev=38.91, samples=17 00:26:20.637 lat (msec) : 100=0.46%, 250=2.92%, 500=4.92%, 750=6.92%, 1000=16.15% 00:26:20.637 lat (msec) : 2000=24.00%, >=2000=44.62% 00:26:20.637 cpu : usr=0.01%, sys=1.16%, ctx=1194, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.637 issued rwts: total=650,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731777: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=65, BW=65.7MiB/s (68.9MB/s)(666MiB/10133msec) 00:26:20.637 slat (usec): min=69, max=93673, avg=15016.56, stdev=19704.43 00:26:20.637 clat (msec): min=128, max=3047, avg=1786.57, stdev=646.01 00:26:20.637 lat (msec): min=184, max=3061, avg=1801.59, stdev=647.54 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 224], 5.00th=[ 527], 10.00th=[ 1183], 20.00th=[ 1284], 00:26:20.637 | 30.00th=[ 1368], 40.00th=[ 1502], 50.00th=[ 1737], 60.00th=[ 2022], 00:26:20.637 | 70.00th=[ 2198], 80.00th=[ 2299], 90.00th=[ 2702], 95.00th=[ 2802], 00:26:20.637 | 99.00th=[ 3004], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], 00:26:20.637 | 99.99th=[ 3037] 00:26:20.637 bw ( KiB/s): min= 2048, max=122880, per=1.29%, avg=64933.65, stdev=29454.60, samples=17 00:26:20.637 iops : min= 2, max= 120, avg=63.41, stdev=28.76, samples=17 00:26:20.637 lat (msec) : 250=1.20%, 500=3.45%, 750=2.10%, 1000=1.20%, 2000=51.50% 00:26:20.637 lat (msec) : >=2000=40.54% 00:26:20.637 cpu : usr=0.04%, sys=1.34%, ctx=1191, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.637 issued rwts: total=666,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731779: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=43, BW=43.1MiB/s (45.2MB/s)(436MiB/10124msec) 00:26:20.637 slat (usec): min=345, max=122629, avg=23017.16, stdev=21266.44 00:26:20.637 clat (msec): min=86, max=3620, avg=2581.54, stdev=839.42 00:26:20.637 lat (msec): min=137, max=3661, avg=2604.56, stdev=839.96 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 207], 5.00th=[ 600], 10.00th=[ 1070], 20.00th=[ 1972], 00:26:20.637 | 30.00th=[ 2702], 40.00th=[ 2802], 50.00th=[ 2869], 60.00th=[ 3004], 00:26:20.637 | 70.00th=[ 3037], 80.00th=[ 3138], 90.00th=[ 3272], 95.00th=[ 3440], 00:26:20.637 | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3608], 99.95th=[ 3608], 00:26:20.637 | 99.99th=[ 3608] 00:26:20.637 bw ( KiB/s): min=22528, max=57344, per=0.84%, avg=42057.73, stdev=8295.43, samples=15 00:26:20.637 iops : min= 22, max= 56, avg=41.07, stdev= 8.10, samples=15 00:26:20.637 lat (msec) : 100=0.23%, 250=1.38%, 500=2.75%, 750=2.29%, 1000=2.29% 00:26:20.637 lat (msec) : 2000=11.47%, >=2000=79.59% 00:26:20.637 cpu : usr=0.04%, sys=0.98%, ctx=1158, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.7%, 32=7.3%, >=64=85.6% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.637 issued rwts: total=436,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731780: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=94, BW=95.0MiB/s (99.6MB/s)(960MiB/10109msec) 00:26:20.637 slat (usec): min=38, max=110731, avg=10417.75, stdev=21609.35 00:26:20.637 clat (msec): min=104, max=2226, avg=1188.76, stdev=377.16 00:26:20.637 lat (msec): min=144, max=2252, avg=1199.18, stdev=378.48 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 220], 5.00th=[ 776], 10.00th=[ 827], 20.00th=[ 885], 00:26:20.637 | 30.00th=[ 961], 40.00th=[ 1011], 50.00th=[ 1183], 60.00th=[ 1250], 00:26:20.637 | 70.00th=[ 1318], 80.00th=[ 1452], 90.00th=[ 1737], 95.00th=[ 1905], 00:26:20.637 | 99.00th=[ 2165], 99.50th=[ 2198], 99.90th=[ 2232], 99.95th=[ 2232], 00:26:20.637 | 99.99th=[ 2232] 00:26:20.637 bw ( KiB/s): min=53248, max=157696, per=2.12%, avg=106606.31, stdev=37167.20, samples=16 00:26:20.637 iops : min= 52, max= 154, avg=104.06, stdev=36.25, samples=16 00:26:20.637 lat (msec) : 250=1.15%, 500=1.67%, 750=1.46%, 1000=34.90%, 2000=57.71% 00:26:20.637 lat (msec) : >=2000=3.12% 00:26:20.637 cpu : usr=0.02%, sys=1.28%, ctx=1240, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.3%, >=64=93.4% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.637 issued rwts: total=960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731781: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=57, BW=57.7MiB/s (60.5MB/s)(584MiB/10116msec) 00:26:20.637 slat (usec): min=103, max=112913, avg=17135.66, stdev=19833.50 00:26:20.637 clat (msec): min=106, max=2882, avg=2017.82, stdev=588.61 00:26:20.637 lat (msec): min=132, max=2910, avg=2034.96, stdev=588.96 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 205], 5.00th=[ 701], 10.00th=[ 1053], 20.00th=[ 1737], 00:26:20.637 | 30.00th=[ 1888], 40.00th=[ 1972], 50.00th=[ 2140], 60.00th=[ 2265], 00:26:20.637 | 70.00th=[ 2433], 80.00th=[ 2534], 90.00th=[ 2601], 95.00th=[ 2635], 00:26:20.637 | 99.00th=[ 2802], 99.50th=[ 2836], 99.90th=[ 2869], 99.95th=[ 2869], 00:26:20.637 | 99.99th=[ 2869] 00:26:20.637 bw ( KiB/s): min=10240, max=98304, per=1.09%, avg=54929.29, stdev=22822.20, samples=17 00:26:20.637 iops : min= 10, max= 96, avg=53.59, stdev=22.31, samples=17 00:26:20.637 lat (msec) : 250=1.54%, 500=1.71%, 750=2.05%, 1000=3.60%, 2000=32.88% 00:26:20.637 lat (msec) : >=2000=58.22% 00:26:20.637 cpu : usr=0.00%, sys=1.25%, ctx=1270, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.5%, >=64=89.2% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.637 issued rwts: total=584,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731782: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=53, BW=53.2MiB/s (55.8MB/s)(540MiB/10153msec) 00:26:20.637 slat (usec): min=38, max=126126, avg=18690.25, stdev=27889.73 00:26:20.637 clat (msec): min=57, max=3270, avg=2147.78, stdev=781.19 00:26:20.637 lat (msec): min=159, max=3312, avg=2166.47, stdev=783.51 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 178], 5.00th=[ 634], 10.00th=[ 1028], 20.00th=[ 1519], 00:26:20.637 | 30.00th=[ 1854], 40.00th=[ 1921], 50.00th=[ 2039], 60.00th=[ 2366], 00:26:20.637 | 70.00th=[ 2769], 80.00th=[ 3004], 90.00th=[ 3104], 95.00th=[ 3171], 00:26:20.637 | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3272], 99.95th=[ 3272], 00:26:20.637 | 99.99th=[ 3272] 00:26:20.637 bw ( KiB/s): min=16384, max=112640, per=0.99%, avg=49629.76, stdev=20857.67, samples=17 00:26:20.637 iops : min= 16, max= 110, avg=48.41, stdev=20.41, samples=17 00:26:20.637 lat (msec) : 100=0.19%, 250=1.30%, 500=2.78%, 750=2.22%, 1000=2.59% 00:26:20.637 lat (msec) : 2000=37.96%, >=2000=52.96% 00:26:20.637 cpu : usr=0.00%, sys=1.13%, ctx=1150, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=5.9%, >=64=88.3% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.637 issued rwts: total=540,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731783: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=45, BW=45.2MiB/s (47.4MB/s)(457MiB/10101msec) 00:26:20.637 slat (usec): min=40, max=116740, avg=21889.16, stdev=23156.71 00:26:20.637 clat (msec): min=95, max=3247, avg=2417.05, stdev=789.36 00:26:20.637 lat (msec): min=101, max=3310, avg=2438.94, stdev=789.91 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 107], 5.00th=[ 384], 10.00th=[ 1011], 20.00th=[ 2089], 00:26:20.637 | 30.00th=[ 2601], 40.00th=[ 2635], 50.00th=[ 2668], 60.00th=[ 2769], 00:26:20.637 | 70.00th=[ 2869], 80.00th=[ 2903], 90.00th=[ 3004], 95.00th=[ 3138], 00:26:20.637 | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.637 | 99.99th=[ 3239] 00:26:20.637 bw ( KiB/s): min=16384, max=69493, per=0.90%, avg=45042.60, stdev=14281.56, samples=15 00:26:20.637 iops : min= 16, max= 67, avg=43.87, stdev=13.91, samples=15 00:26:20.637 lat (msec) : 100=0.22%, 250=3.72%, 500=2.19%, 750=1.53%, 1000=2.19% 00:26:20.637 lat (msec) : 2000=9.19%, >=2000=80.96% 00:26:20.637 cpu : usr=0.04%, sys=0.92%, ctx=1175, majf=0, minf=32769 00:26:20.637 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.5%, 32=7.0%, >=64=86.2% 00:26:20.637 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.637 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.637 issued rwts: total=457,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.637 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.637 job3: (groupid=0, jobs=1): err= 0: pid=731784: Wed Apr 24 15:27:22 2024 00:26:20.637 read: IOPS=67, BW=67.2MiB/s (70.4MB/s)(681MiB/10136msec) 00:26:20.637 slat (usec): min=42, max=113855, avg=14730.45, stdev=19699.87 00:26:20.637 clat (msec): min=101, max=2847, avg=1697.13, stdev=655.96 00:26:20.637 lat (msec): min=151, max=2850, avg=1711.86, stdev=657.64 00:26:20.637 clat percentiles (msec): 00:26:20.637 | 1.00th=[ 220], 5.00th=[ 531], 10.00th=[ 969], 20.00th=[ 1028], 00:26:20.638 | 30.00th=[ 1133], 40.00th=[ 1519], 50.00th=[ 1838], 60.00th=[ 1955], 00:26:20.638 | 70.00th=[ 2140], 80.00th=[ 2333], 90.00th=[ 2534], 95.00th=[ 2668], 00:26:20.638 | 99.00th=[ 2769], 99.50th=[ 2802], 99.90th=[ 2836], 99.95th=[ 2836], 00:26:20.638 | 99.99th=[ 2836] 00:26:20.638 bw ( KiB/s): min=10240, max=139264, per=1.41%, avg=70784.00, stdev=36551.45, samples=16 00:26:20.638 iops : min= 10, max= 136, avg=69.12, stdev=35.69, samples=16 00:26:20.638 lat (msec) : 250=1.03%, 500=2.50%, 750=2.79%, 1000=10.28%, 2000=44.49% 00:26:20.638 lat (msec) : >=2000=38.91% 00:26:20.638 cpu : usr=0.00%, sys=1.31%, ctx=1261, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.7%, >=64=90.7% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.638 issued rwts: total=681,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job3: (groupid=0, jobs=1): err= 0: pid=731785: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=96, BW=96.2MiB/s (101MB/s)(971MiB/10094msec) 00:26:20.638 slat (usec): min=37, max=125549, avg=10296.44, stdev=26590.70 00:26:20.638 clat (msec): min=91, max=2456, avg=1256.04, stdev=384.11 00:26:20.638 lat (msec): min=93, max=2458, avg=1266.34, stdev=384.24 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 249], 5.00th=[ 852], 10.00th=[ 911], 20.00th=[ 1053], 00:26:20.638 | 30.00th=[ 1083], 40.00th=[ 1116], 50.00th=[ 1200], 60.00th=[ 1250], 00:26:20.638 | 70.00th=[ 1318], 80.00th=[ 1452], 90.00th=[ 1770], 95.00th=[ 2198], 00:26:20.638 | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2467], 99.95th=[ 2467], 00:26:20.638 | 99.99th=[ 2467] 00:26:20.638 bw ( KiB/s): min=49152, max=157696, per=1.91%, avg=96028.44, stdev=32842.37, samples=18 00:26:20.638 iops : min= 48, max= 154, avg=93.78, stdev=32.07, samples=18 00:26:20.638 lat (msec) : 100=0.21%, 250=0.82%, 500=1.75%, 750=1.65%, 1000=9.78% 00:26:20.638 lat (msec) : 2000=78.58%, >=2000=7.21% 00:26:20.638 cpu : usr=0.08%, sys=1.55%, ctx=1096, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.5% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.638 issued rwts: total=971,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job3: (groupid=0, jobs=1): err= 0: pid=731786: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=60, BW=60.7MiB/s (63.6MB/s)(613MiB/10104msec) 00:26:20.638 slat (usec): min=81, max=86506, avg=16320.70, stdev=19241.34 00:26:20.638 clat (msec): min=96, max=2616, avg=1887.82, stdev=544.31 00:26:20.638 lat (msec): min=106, max=2636, avg=1904.14, stdev=544.74 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 176], 5.00th=[ 592], 10.00th=[ 1150], 20.00th=[ 1502], 00:26:20.638 | 30.00th=[ 1687], 40.00th=[ 1938], 50.00th=[ 2140], 60.00th=[ 2198], 00:26:20.638 | 70.00th=[ 2232], 80.00th=[ 2265], 90.00th=[ 2366], 95.00th=[ 2433], 00:26:20.638 | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], 00:26:20.638 | 99.99th=[ 2601] 00:26:20.638 bw ( KiB/s): min=43008, max=90112, per=1.17%, avg=58548.71, stdev=11699.15, samples=17 00:26:20.638 iops : min= 42, max= 88, avg=57.18, stdev=11.42, samples=17 00:26:20.638 lat (msec) : 100=0.16%, 250=1.63%, 500=2.12%, 750=2.61%, 1000=2.45% 00:26:20.638 lat (msec) : 2000=34.42%, >=2000=56.61% 00:26:20.638 cpu : usr=0.00%, sys=1.12%, ctx=1207, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.7% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.638 issued rwts: total=613,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job4: (groupid=0, jobs=1): err= 0: pid=731800: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=41, BW=41.4MiB/s (43.5MB/s)(421MiB/10157msec) 00:26:20.638 slat (usec): min=401, max=159924, avg=23814.42, stdev=29454.90 00:26:20.638 clat (msec): min=128, max=4328, avg=2951.88, stdev=1094.98 00:26:20.638 lat (msec): min=192, max=4351, avg=2975.69, stdev=1098.33 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 220], 5.00th=[ 743], 10.00th=[ 1284], 20.00th=[ 1921], 00:26:20.638 | 30.00th=[ 2400], 40.00th=[ 3004], 50.00th=[ 3373], 60.00th=[ 3574], 00:26:20.638 | 70.00th=[ 3641], 80.00th=[ 3943], 90.00th=[ 4111], 95.00th=[ 4178], 00:26:20.638 | 99.00th=[ 4279], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], 00:26:20.638 | 99.99th=[ 4329] 00:26:20.638 bw ( KiB/s): min=16384, max=51200, per=0.66%, avg=33336.89, stdev=8683.41, samples=18 00:26:20.638 iops : min= 16, max= 50, avg=32.56, stdev= 8.48, samples=18 00:26:20.638 lat (msec) : 250=1.19%, 500=1.90%, 750=2.61%, 1000=2.14%, 2000=13.78% 00:26:20.638 lat (msec) : >=2000=78.38% 00:26:20.638 cpu : usr=0.00%, sys=1.22%, ctx=1172, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.0% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.638 issued rwts: total=421,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job4: (groupid=0, jobs=1): err= 0: pid=731801: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=89, BW=89.4MiB/s (93.8MB/s)(900MiB/10064msec) 00:26:20.638 slat (usec): min=36, max=127200, avg=11116.50, stdev=28062.43 00:26:20.638 clat (msec): min=55, max=2187, avg=1297.48, stdev=521.22 00:26:20.638 lat (msec): min=71, max=2189, avg=1308.59, stdev=524.14 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 97], 5.00th=[ 300], 10.00th=[ 642], 20.00th=[ 911], 00:26:20.638 | 30.00th=[ 944], 40.00th=[ 1003], 50.00th=[ 1401], 60.00th=[ 1586], 00:26:20.638 | 70.00th=[ 1703], 80.00th=[ 1787], 90.00th=[ 1938], 95.00th=[ 2056], 00:26:20.638 | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2198], 99.95th=[ 2198], 00:26:20.638 | 99.99th=[ 2198] 00:26:20.638 bw ( KiB/s): min=40960, max=159744, per=1.85%, avg=93101.53, stdev=39365.87, samples=17 00:26:20.638 iops : min= 40, max= 156, avg=90.76, stdev=38.57, samples=17 00:26:20.638 lat (msec) : 100=1.22%, 250=2.22%, 500=3.56%, 750=5.11%, 1000=27.56% 00:26:20.638 lat (msec) : 2000=52.33%, >=2000=8.00% 00:26:20.638 cpu : usr=0.01%, sys=1.20%, ctx=1145, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=93.0% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.638 issued rwts: total=900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job4: (groupid=0, jobs=1): err= 0: pid=731802: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=42, BW=42.6MiB/s (44.7MB/s)(430MiB/10086msec) 00:26:20.638 slat (usec): min=117, max=136989, avg=23292.77, stdev=29627.28 00:26:20.638 clat (msec): min=68, max=4164, avg=2599.26, stdev=1196.00 00:26:20.638 lat (msec): min=116, max=4235, avg=2622.56, stdev=1200.78 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 136], 5.00th=[ 384], 10.00th=[ 751], 20.00th=[ 1301], 00:26:20.638 | 30.00th=[ 2039], 40.00th=[ 2500], 50.00th=[ 2970], 60.00th=[ 3071], 00:26:20.638 | 70.00th=[ 3440], 80.00th=[ 3842], 90.00th=[ 3977], 95.00th=[ 4010], 00:26:20.638 | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4178], 99.95th=[ 4178], 00:26:20.638 | 99.99th=[ 4178] 00:26:20.638 bw ( KiB/s): min=12288, max=100352, per=0.82%, avg=41233.07, stdev=23271.97, samples=15 00:26:20.638 iops : min= 12, max= 98, avg=40.27, stdev=22.73, samples=15 00:26:20.638 lat (msec) : 100=0.23%, 250=2.33%, 500=3.72%, 750=3.72%, 1000=7.21% 00:26:20.638 lat (msec) : 2000=10.47%, >=2000=72.33% 00:26:20.638 cpu : usr=0.04%, sys=1.00%, ctx=1198, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.7%, 32=7.4%, >=64=85.3% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.638 issued rwts: total=430,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job4: (groupid=0, jobs=1): err= 0: pid=731803: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=44, BW=44.2MiB/s (46.3MB/s)(448MiB/10144msec) 00:26:20.638 slat (usec): min=55, max=139267, avg=22367.36, stdev=29484.99 00:26:20.638 clat (msec): min=121, max=3639, avg=2564.51, stdev=714.24 00:26:20.638 lat (msec): min=167, max=3641, avg=2586.87, stdev=711.71 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 342], 5.00th=[ 902], 10.00th=[ 1569], 20.00th=[ 2232], 00:26:20.638 | 30.00th=[ 2433], 40.00th=[ 2500], 50.00th=[ 2635], 60.00th=[ 2802], 00:26:20.638 | 70.00th=[ 2970], 80.00th=[ 3171], 90.00th=[ 3373], 95.00th=[ 3440], 00:26:20.638 | 99.00th=[ 3540], 99.50th=[ 3608], 99.90th=[ 3641], 99.95th=[ 3641], 00:26:20.638 | 99.99th=[ 3641] 00:26:20.638 bw ( KiB/s): min= 2048, max=67584, per=0.82%, avg=40960.00, stdev=18133.77, samples=16 00:26:20.638 iops : min= 2, max= 66, avg=40.00, stdev=17.71, samples=16 00:26:20.638 lat (msec) : 250=0.67%, 500=0.89%, 750=1.79%, 1000=2.01%, 2000=9.60% 00:26:20.638 lat (msec) : >=2000=85.04% 00:26:20.638 cpu : usr=0.03%, sys=1.03%, ctx=1139, majf=0, minf=32769 00:26:20.638 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.1%, >=64=85.9% 00:26:20.638 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.638 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.638 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.638 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.638 job4: (groupid=0, jobs=1): err= 0: pid=731804: Wed Apr 24 15:27:22 2024 00:26:20.638 read: IOPS=39, BW=39.1MiB/s (41.0MB/s)(394MiB/10088msec) 00:26:20.638 slat (usec): min=445, max=131184, avg=25381.32, stdev=27622.41 00:26:20.638 clat (msec): min=86, max=4554, avg=2907.68, stdev=1296.79 00:26:20.638 lat (msec): min=104, max=4557, avg=2933.06, stdev=1300.98 00:26:20.638 clat percentiles (msec): 00:26:20.638 | 1.00th=[ 113], 5.00th=[ 359], 10.00th=[ 735], 20.00th=[ 1586], 00:26:20.638 | 30.00th=[ 2534], 40.00th=[ 2836], 50.00th=[ 3104], 60.00th=[ 3440], 00:26:20.638 | 70.00th=[ 3910], 80.00th=[ 4212], 90.00th=[ 4396], 95.00th=[ 4463], 00:26:20.638 | 99.00th=[ 4463], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], 00:26:20.638 | 99.99th=[ 4530] 00:26:20.638 bw ( KiB/s): min=20480, max=65536, per=0.73%, avg=36454.40, stdev=12365.77, samples=15 00:26:20.638 iops : min= 20, max= 64, avg=35.60, stdev=12.08, samples=15 00:26:20.638 lat (msec) : 100=0.25%, 250=3.05%, 500=4.31%, 750=2.54%, 1000=3.05% 00:26:20.638 lat (msec) : 2000=12.44%, >=2000=74.37% 00:26:20.638 cpu : usr=0.00%, sys=1.01%, ctx=1133, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.1%, 32=8.1%, >=64=84.0% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:20.639 issued rwts: total=394,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731805: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=44, BW=44.9MiB/s (47.1MB/s)(455MiB/10126msec) 00:26:20.639 slat (usec): min=38, max=195807, avg=21986.45, stdev=27156.16 00:26:20.639 clat (msec): min=119, max=3704, avg=2341.99, stdev=868.94 00:26:20.639 lat (msec): min=155, max=3717, avg=2363.98, stdev=869.41 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 249], 5.00th=[ 776], 10.00th=[ 1469], 20.00th=[ 1569], 00:26:20.639 | 30.00th=[ 1770], 40.00th=[ 2039], 50.00th=[ 2265], 60.00th=[ 2601], 00:26:20.639 | 70.00th=[ 3104], 80.00th=[ 3272], 90.00th=[ 3406], 95.00th=[ 3608], 00:26:20.639 | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3708], 99.95th=[ 3708], 00:26:20.639 | 99.99th=[ 3708] 00:26:20.639 bw ( KiB/s): min=26624, max=86016, per=0.89%, avg=44782.93, stdev=20316.48, samples=15 00:26:20.639 iops : min= 26, max= 84, avg=43.73, stdev=19.84, samples=15 00:26:20.639 lat (msec) : 250=1.32%, 500=1.54%, 750=1.98%, 1000=1.76%, 2000=31.87% 00:26:20.639 lat (msec) : >=2000=61.54% 00:26:20.639 cpu : usr=0.05%, sys=0.92%, ctx=1163, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.5%, 32=7.0%, >=64=86.2% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.639 issued rwts: total=455,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731807: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=41, BW=41.9MiB/s (43.9MB/s)(422MiB/10070msec) 00:26:20.639 slat (usec): min=411, max=131125, avg=23724.29, stdev=26247.47 00:26:20.639 clat (msec): min=56, max=4664, avg=2802.95, stdev=1294.09 00:26:20.639 lat (msec): min=71, max=4689, avg=2826.67, stdev=1298.46 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 134], 5.00th=[ 380], 10.00th=[ 743], 20.00th=[ 1871], 00:26:20.639 | 30.00th=[ 2089], 40.00th=[ 2467], 50.00th=[ 2802], 60.00th=[ 3272], 00:26:20.639 | 70.00th=[ 3742], 80.00th=[ 4245], 90.00th=[ 4463], 95.00th=[ 4530], 00:26:20.639 | 99.00th=[ 4597], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:26:20.639 | 99.99th=[ 4665] 00:26:20.639 bw ( KiB/s): min=14336, max=65536, per=0.71%, avg=35417.82, stdev=14202.33, samples=17 00:26:20.639 iops : min= 14, max= 64, avg=34.53, stdev=13.89, samples=17 00:26:20.639 lat (msec) : 100=0.47%, 250=2.37%, 500=3.55%, 750=4.03%, 1000=2.13% 00:26:20.639 lat (msec) : 2000=12.09%, >=2000=75.36% 00:26:20.639 cpu : usr=0.01%, sys=1.05%, ctx=1148, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.1% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.639 issued rwts: total=422,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731808: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=47, BW=47.8MiB/s (50.2MB/s)(484MiB/10118msec) 00:26:20.639 slat (usec): min=67, max=119219, avg=20785.74, stdev=24366.72 00:26:20.639 clat (msec): min=55, max=3235, avg=2273.74, stdev=642.44 00:26:20.639 lat (msec): min=137, max=3246, avg=2294.53, stdev=642.17 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 251], 5.00th=[ 936], 10.00th=[ 1217], 20.00th=[ 1921], 00:26:20.639 | 30.00th=[ 2265], 40.00th=[ 2400], 50.00th=[ 2467], 60.00th=[ 2534], 00:26:20.639 | 70.00th=[ 2635], 80.00th=[ 2702], 90.00th=[ 2869], 95.00th=[ 3071], 00:26:20.639 | 99.00th=[ 3205], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.639 | 99.99th=[ 3239] 00:26:20.639 bw ( KiB/s): min=14336, max=106496, per=0.97%, avg=48596.00, stdev=22918.03, samples=15 00:26:20.639 iops : min= 14, max= 104, avg=47.40, stdev=22.32, samples=15 00:26:20.639 lat (msec) : 100=0.21%, 250=0.62%, 500=1.24%, 750=1.65%, 1000=1.65% 00:26:20.639 lat (msec) : 2000=15.29%, >=2000=79.34% 00:26:20.639 cpu : usr=0.00%, sys=1.00%, ctx=1205, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.639 issued rwts: total=484,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731809: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=38, BW=38.8MiB/s (40.7MB/s)(392MiB/10093msec) 00:26:20.639 slat (usec): min=111, max=115879, avg=25600.16, stdev=26519.17 00:26:20.639 clat (msec): min=55, max=3654, avg=2775.19, stdev=998.91 00:26:20.639 lat (msec): min=103, max=3687, avg=2800.79, stdev=999.66 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 105], 5.00th=[ 401], 10.00th=[ 1036], 20.00th=[ 2123], 00:26:20.639 | 30.00th=[ 2836], 40.00th=[ 3037], 50.00th=[ 3306], 60.00th=[ 3373], 00:26:20.639 | 70.00th=[ 3406], 80.00th=[ 3440], 90.00th=[ 3540], 95.00th=[ 3574], 00:26:20.639 | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], 00:26:20.639 | 99.99th=[ 3641] 00:26:20.639 bw ( KiB/s): min=28672, max=59392, per=0.77%, avg=38619.43, stdev=10188.11, samples=14 00:26:20.639 iops : min= 28, max= 58, avg=37.71, stdev= 9.95, samples=14 00:26:20.639 lat (msec) : 100=0.26%, 250=4.08%, 500=1.53%, 750=2.81%, 1000=1.28% 00:26:20.639 lat (msec) : 2000=9.44%, >=2000=80.61% 00:26:20.639 cpu : usr=0.07%, sys=0.92%, ctx=1182, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.1%, 32=8.2%, >=64=83.9% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:20.639 issued rwts: total=392,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731810: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=65, BW=65.3MiB/s (68.4MB/s)(659MiB/10098msec) 00:26:20.639 slat (usec): min=49, max=141630, avg=15171.62, stdev=28994.75 00:26:20.639 clat (msec): min=97, max=2866, avg=1725.46, stdev=625.64 00:26:20.639 lat (msec): min=99, max=2897, avg=1740.64, stdev=627.67 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 107], 5.00th=[ 506], 10.00th=[ 986], 20.00th=[ 1167], 00:26:20.639 | 30.00th=[ 1334], 40.00th=[ 1620], 50.00th=[ 1888], 60.00th=[ 2022], 00:26:20.639 | 70.00th=[ 2089], 80.00th=[ 2232], 90.00th=[ 2467], 95.00th=[ 2601], 00:26:20.639 | 99.00th=[ 2836], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], 00:26:20.639 | 99.99th=[ 2869] 00:26:20.639 bw ( KiB/s): min=26624, max=126976, per=1.36%, avg=68100.06, stdev=28029.65, samples=16 00:26:20.639 iops : min= 26, max= 124, avg=66.44, stdev=27.38, samples=16 00:26:20.639 lat (msec) : 100=0.30%, 250=2.43%, 500=1.67%, 750=3.03%, 1000=2.58% 00:26:20.639 lat (msec) : 2000=47.34%, >=2000=42.64% 00:26:20.639 cpu : usr=0.03%, sys=1.11%, ctx=1109, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.9%, >=64=90.4% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.639 issued rwts: total=659,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731811: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=115, BW=116MiB/s (121MB/s)(1168MiB/10109msec) 00:26:20.639 slat (usec): min=34, max=138175, avg=8632.15, stdev=25167.54 00:26:20.639 clat (msec): min=23, max=1725, avg=1021.10, stdev=237.60 00:26:20.639 lat (msec): min=116, max=1725, avg=1029.73, stdev=238.52 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 131], 5.00th=[ 531], 10.00th=[ 860], 20.00th=[ 927], 00:26:20.639 | 30.00th=[ 995], 40.00th=[ 1020], 50.00th=[ 1036], 60.00th=[ 1053], 00:26:20.639 | 70.00th=[ 1083], 80.00th=[ 1099], 90.00th=[ 1183], 95.00th=[ 1569], 00:26:20.639 | 99.00th=[ 1653], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], 00:26:20.639 | 99.99th=[ 1720] 00:26:20.639 bw ( KiB/s): min=108544, max=155648, per=2.50%, avg=125289.41, stdev=12207.42, samples=17 00:26:20.639 iops : min= 106, max= 152, avg=122.35, stdev=11.92, samples=17 00:26:20.639 lat (msec) : 50=0.09%, 250=1.28%, 500=2.65%, 750=2.65%, 1000=25.26% 00:26:20.639 lat (msec) : 2000=68.07% 00:26:20.639 cpu : usr=0.03%, sys=1.31%, ctx=1117, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.4%, 32=2.7%, >=64=94.6% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.639 issued rwts: total=1168,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731812: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=66, BW=66.1MiB/s (69.3MB/s)(670MiB/10137msec) 00:26:20.639 slat (usec): min=55, max=168007, avg=14975.70, stdev=30103.76 00:26:20.639 clat (msec): min=100, max=2615, avg=1769.29, stdev=539.02 00:26:20.639 lat (msec): min=163, max=2621, avg=1784.27, stdev=539.46 00:26:20.639 clat percentiles (msec): 00:26:20.639 | 1.00th=[ 232], 5.00th=[ 785], 10.00th=[ 1116], 20.00th=[ 1301], 00:26:20.639 | 30.00th=[ 1502], 40.00th=[ 1586], 50.00th=[ 1854], 60.00th=[ 2005], 00:26:20.639 | 70.00th=[ 2089], 80.00th=[ 2299], 90.00th=[ 2467], 95.00th=[ 2534], 00:26:20.639 | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], 00:26:20.639 | 99.99th=[ 2601] 00:26:20.639 bw ( KiB/s): min=43008, max=118784, per=1.30%, avg=65295.06, stdev=20720.28, samples=17 00:26:20.639 iops : min= 42, max= 116, avg=63.76, stdev=20.23, samples=17 00:26:20.639 lat (msec) : 250=1.19%, 500=1.34%, 750=1.64%, 1000=2.09%, 2000=52.09% 00:26:20.639 lat (msec) : >=2000=41.64% 00:26:20.639 cpu : usr=0.02%, sys=1.19%, ctx=1028, majf=0, minf=32769 00:26:20.639 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.6% 00:26:20.639 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.639 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.639 issued rwts: total=670,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.639 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.639 job4: (groupid=0, jobs=1): err= 0: pid=731813: Wed Apr 24 15:27:22 2024 00:26:20.639 read: IOPS=118, BW=119MiB/s (124MB/s)(1192MiB/10054msec) 00:26:20.639 slat (usec): min=37, max=123642, avg=8395.52, stdev=22485.23 00:26:20.640 clat (msec): min=42, max=1583, avg=975.92, stdev=254.40 00:26:20.640 lat (msec): min=59, max=1593, avg=984.32, stdev=255.94 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 110], 5.00th=[ 447], 10.00th=[ 743], 20.00th=[ 835], 00:26:20.640 | 30.00th=[ 894], 40.00th=[ 927], 50.00th=[ 978], 60.00th=[ 1045], 00:26:20.640 | 70.00th=[ 1116], 80.00th=[ 1200], 90.00th=[ 1250], 95.00th=[ 1334], 00:26:20.640 | 99.00th=[ 1469], 99.50th=[ 1519], 99.90th=[ 1569], 99.95th=[ 1586], 00:26:20.640 | 99.99th=[ 1586] 00:26:20.640 bw ( KiB/s): min=86016, max=174080, per=2.55%, avg=128180.71, stdev=26337.50, samples=17 00:26:20.640 iops : min= 84, max= 170, avg=125.18, stdev=25.72, samples=17 00:26:20.640 lat (msec) : 50=0.08%, 100=0.34%, 250=2.68%, 500=2.60%, 750=5.12% 00:26:20.640 lat (msec) : 1000=42.20%, 2000=46.98% 00:26:20.640 cpu : usr=0.04%, sys=1.22%, ctx=1205, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.7%, >=64=94.7% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:20.640 issued rwts: total=1192,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731822: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=59, BW=59.8MiB/s (62.7MB/s)(605MiB/10122msec) 00:26:20.640 slat (usec): min=49, max=133087, avg=16531.72, stdev=23571.12 00:26:20.640 clat (msec): min=117, max=3205, avg=1998.67, stdev=601.52 00:26:20.640 lat (msec): min=134, max=3231, avg=2015.20, stdev=601.35 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 255], 5.00th=[ 701], 10.00th=[ 1536], 20.00th=[ 1720], 00:26:20.640 | 30.00th=[ 1804], 40.00th=[ 1871], 50.00th=[ 1938], 60.00th=[ 2039], 00:26:20.640 | 70.00th=[ 2165], 80.00th=[ 2366], 90.00th=[ 2937], 95.00th=[ 3104], 00:26:20.640 | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3205], 99.95th=[ 3205], 00:26:20.640 | 99.99th=[ 3205] 00:26:20.640 bw ( KiB/s): min=28672, max=96256, per=1.15%, avg=57584.94, stdev=18935.45, samples=17 00:26:20.640 iops : min= 28, max= 94, avg=56.24, stdev=18.49, samples=17 00:26:20.640 lat (msec) : 250=0.99%, 500=1.82%, 750=2.48%, 1000=1.32%, 2000=50.91% 00:26:20.640 lat (msec) : >=2000=42.48% 00:26:20.640 cpu : usr=0.02%, sys=1.15%, ctx=1090, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.640 issued rwts: total=605,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731823: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=55, BW=55.3MiB/s (58.0MB/s)(560MiB/10125msec) 00:26:20.640 slat (usec): min=39, max=116294, avg=17857.37, stdev=25432.42 00:26:20.640 clat (msec): min=122, max=2965, avg=2071.59, stdev=633.67 00:26:20.640 lat (msec): min=126, max=2967, avg=2089.45, stdev=633.46 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 239], 5.00th=[ 735], 10.00th=[ 1250], 20.00th=[ 1586], 00:26:20.640 | 30.00th=[ 1770], 40.00th=[ 1989], 50.00th=[ 2232], 60.00th=[ 2366], 00:26:20.640 | 70.00th=[ 2500], 80.00th=[ 2668], 90.00th=[ 2769], 95.00th=[ 2836], 00:26:20.640 | 99.00th=[ 2937], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], 00:26:20.640 | 99.99th=[ 2970] 00:26:20.640 bw ( KiB/s): min=18432, max=90112, per=1.10%, avg=55431.94, stdev=22765.25, samples=16 00:26:20.640 iops : min= 18, max= 88, avg=54.12, stdev=22.23, samples=16 00:26:20.640 lat (msec) : 250=1.07%, 500=1.43%, 750=3.04%, 1000=2.68%, 2000=32.32% 00:26:20.640 lat (msec) : >=2000=59.46% 00:26:20.640 cpu : usr=0.02%, sys=1.09%, ctx=1121, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.8% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.640 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731825: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=53, BW=53.6MiB/s (56.2MB/s)(544MiB/10152msec) 00:26:20.640 slat (usec): min=40, max=143405, avg=18424.61, stdev=29066.51 00:26:20.640 clat (msec): min=127, max=3125, avg=2206.82, stdev=624.87 00:26:20.640 lat (msec): min=173, max=3127, avg=2225.24, stdev=623.54 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 342], 5.00th=[ 936], 10.00th=[ 1502], 20.00th=[ 1687], 00:26:20.640 | 30.00th=[ 1955], 40.00th=[ 2140], 50.00th=[ 2299], 60.00th=[ 2500], 00:26:20.640 | 70.00th=[ 2668], 80.00th=[ 2769], 90.00th=[ 2903], 95.00th=[ 3004], 00:26:20.640 | 99.00th=[ 3071], 99.50th=[ 3104], 99.90th=[ 3138], 99.95th=[ 3138], 00:26:20.640 | 99.99th=[ 3138] 00:26:20.640 bw ( KiB/s): min=20480, max=151552, per=1.00%, avg=50115.76, stdev=29714.69, samples=17 00:26:20.640 iops : min= 20, max= 148, avg=48.94, stdev=29.02, samples=17 00:26:20.640 lat (msec) : 250=0.74%, 500=1.10%, 750=0.92%, 1000=3.68%, 2000=25.74% 00:26:20.640 lat (msec) : >=2000=67.83% 00:26:20.640 cpu : usr=0.03%, sys=1.26%, ctx=1195, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=2.9%, 32=5.9%, >=64=88.4% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.640 issued rwts: total=544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731826: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=77, BW=77.9MiB/s (81.6MB/s)(790MiB/10146msec) 00:26:20.640 slat (usec): min=43, max=131127, avg=12678.01, stdev=23000.30 00:26:20.640 clat (msec): min=127, max=2363, avg=1542.46, stdev=499.30 00:26:20.640 lat (msec): min=219, max=2379, avg=1555.14, stdev=501.01 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 249], 5.00th=[ 600], 10.00th=[ 1062], 20.00th=[ 1167], 00:26:20.640 | 30.00th=[ 1250], 40.00th=[ 1351], 50.00th=[ 1418], 60.00th=[ 1687], 00:26:20.640 | 70.00th=[ 1938], 80.00th=[ 2089], 90.00th=[ 2198], 95.00th=[ 2232], 00:26:20.640 | 99.00th=[ 2299], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], 00:26:20.640 | 99.99th=[ 2366] 00:26:20.640 bw ( KiB/s): min=40960, max=122880, per=1.50%, avg=75320.89, stdev=23303.79, samples=18 00:26:20.640 iops : min= 40, max= 120, avg=73.56, stdev=22.76, samples=18 00:26:20.640 lat (msec) : 250=1.01%, 500=3.42%, 750=1.39%, 1000=2.66%, 2000=65.32% 00:26:20.640 lat (msec) : >=2000=26.20% 00:26:20.640 cpu : usr=0.03%, sys=1.55%, ctx=1039, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.1%, >=64=92.0% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.640 issued rwts: total=790,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731827: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=59, BW=59.9MiB/s (62.8MB/s)(605MiB/10102msec) 00:26:20.640 slat (usec): min=40, max=158658, avg=16605.65, stdev=24839.88 00:26:20.640 clat (msec): min=52, max=2448, avg=1935.99, stdev=520.13 00:26:20.640 lat (msec): min=132, max=2500, avg=1952.59, stdev=519.69 00:26:20.640 clat percentiles (msec): 00:26:20.640 | 1.00th=[ 249], 5.00th=[ 676], 10.00th=[ 1200], 20.00th=[ 1586], 00:26:20.640 | 30.00th=[ 1838], 40.00th=[ 2123], 50.00th=[ 2165], 60.00th=[ 2232], 00:26:20.640 | 70.00th=[ 2265], 80.00th=[ 2299], 90.00th=[ 2333], 95.00th=[ 2366], 00:26:20.640 | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], 00:26:20.640 | 99.99th=[ 2433] 00:26:20.640 bw ( KiB/s): min=34816, max=81920, per=1.14%, avg=57464.47, stdev=13103.01, samples=17 00:26:20.640 iops : min= 34, max= 80, avg=56.12, stdev=12.80, samples=17 00:26:20.640 lat (msec) : 100=0.17%, 250=0.99%, 500=2.15%, 750=1.98%, 1000=2.81% 00:26:20.640 lat (msec) : 2000=28.10%, >=2000=63.80% 00:26:20.640 cpu : usr=0.00%, sys=1.07%, ctx=1083, majf=0, minf=32769 00:26:20.640 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:26:20.640 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.640 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.640 issued rwts: total=605,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.640 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.640 job5: (groupid=0, jobs=1): err= 0: pid=731828: Wed Apr 24 15:27:22 2024 00:26:20.640 read: IOPS=49, BW=49.2MiB/s (51.6MB/s)(498MiB/10120msec) 00:26:20.641 slat (usec): min=61, max=192203, avg=20100.36, stdev=28755.04 00:26:20.641 clat (msec): min=107, max=3237, avg=2184.59, stdev=720.84 00:26:20.641 lat (msec): min=127, max=3258, avg=2204.69, stdev=721.09 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 190], 5.00th=[ 776], 10.00th=[ 961], 20.00th=[ 1653], 00:26:20.641 | 30.00th=[ 1737], 40.00th=[ 2198], 50.00th=[ 2467], 60.00th=[ 2567], 00:26:20.641 | 70.00th=[ 2668], 80.00th=[ 2802], 90.00th=[ 2903], 95.00th=[ 3071], 00:26:20.641 | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], 00:26:20.641 | 99.99th=[ 3239] 00:26:20.641 bw ( KiB/s): min=24576, max=116736, per=1.08%, avg=54125.71, stdev=24846.45, samples=14 00:26:20.641 iops : min= 24, max= 114, avg=52.86, stdev=24.26, samples=14 00:26:20.641 lat (msec) : 250=1.20%, 500=1.41%, 750=0.80%, 1000=6.83%, 2000=25.90% 00:26:20.641 lat (msec) : >=2000=63.86% 00:26:20.641 cpu : usr=0.00%, sys=1.06%, ctx=1117, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.2%, 32=6.4%, >=64=87.3% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:20.641 issued rwts: total=498,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731829: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=70, BW=70.4MiB/s (73.8MB/s)(715MiB/10153msec) 00:26:20.641 slat (usec): min=50, max=146607, avg=14043.09, stdev=28215.85 00:26:20.641 clat (msec): min=109, max=3209, avg=1686.63, stdev=628.82 00:26:20.641 lat (msec): min=231, max=3209, avg=1700.67, stdev=630.67 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 239], 5.00th=[ 506], 10.00th=[ 1083], 20.00th=[ 1267], 00:26:20.641 | 30.00th=[ 1334], 40.00th=[ 1452], 50.00th=[ 1586], 60.00th=[ 1821], 00:26:20.641 | 70.00th=[ 1955], 80.00th=[ 2165], 90.00th=[ 2467], 95.00th=[ 2869], 00:26:20.641 | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], 00:26:20.641 | 99.99th=[ 3205] 00:26:20.641 bw ( KiB/s): min=12288, max=124928, per=1.33%, avg=66787.56, stdev=34284.99, samples=18 00:26:20.641 iops : min= 12, max= 122, avg=65.22, stdev=33.48, samples=18 00:26:20.641 lat (msec) : 250=2.38%, 500=2.10%, 750=3.22%, 1000=1.12%, 2000=64.06% 00:26:20.641 lat (msec) : >=2000=27.13% 00:26:20.641 cpu : usr=0.03%, sys=1.20%, ctx=1124, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.641 issued rwts: total=715,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731830: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=68, BW=69.0MiB/s (72.3MB/s)(694MiB/10064msec) 00:26:20.641 slat (usec): min=46, max=116401, avg=14408.36, stdev=25806.81 00:26:20.641 clat (msec): min=61, max=2319, avg=1661.53, stdev=458.65 00:26:20.641 lat (msec): min=98, max=2335, avg=1675.94, stdev=458.53 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 133], 5.00th=[ 600], 10.00th=[ 1167], 20.00th=[ 1385], 00:26:20.641 | 30.00th=[ 1569], 40.00th=[ 1670], 50.00th=[ 1687], 60.00th=[ 1888], 00:26:20.641 | 70.00th=[ 1955], 80.00th=[ 2039], 90.00th=[ 2140], 95.00th=[ 2232], 00:26:20.641 | 99.00th=[ 2265], 99.50th=[ 2299], 99.90th=[ 2333], 99.95th=[ 2333], 00:26:20.641 | 99.99th=[ 2333] 00:26:20.641 bw ( KiB/s): min=49152, max=122880, per=1.45%, avg=72576.00, stdev=22903.06, samples=16 00:26:20.641 iops : min= 48, max= 120, avg=70.88, stdev=22.37, samples=16 00:26:20.641 lat (msec) : 100=0.29%, 250=2.02%, 500=2.31%, 750=2.16%, 1000=1.44% 00:26:20.641 lat (msec) : 2000=67.44%, >=2000=24.35% 00:26:20.641 cpu : usr=0.00%, sys=1.18%, ctx=1193, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.641 issued rwts: total=694,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731831: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=65, BW=65.9MiB/s (69.1MB/s)(665MiB/10085msec) 00:26:20.641 slat (usec): min=38, max=154512, avg=15079.91, stdev=30678.32 00:26:20.641 clat (msec): min=54, max=3295, avg=1705.99, stdev=773.63 00:26:20.641 lat (msec): min=132, max=3297, avg=1721.07, stdev=775.87 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 213], 5.00th=[ 995], 10.00th=[ 1003], 20.00th=[ 1003], 00:26:20.641 | 30.00th=[ 1003], 40.00th=[ 1116], 50.00th=[ 1569], 60.00th=[ 1888], 00:26:20.641 | 70.00th=[ 2165], 80.00th=[ 2433], 90.00th=[ 2937], 95.00th=[ 3104], 00:26:20.641 | 99.00th=[ 3205], 99.50th=[ 3272], 99.90th=[ 3306], 99.95th=[ 3306], 00:26:20.641 | 99.99th=[ 3306] 00:26:20.641 bw ( KiB/s): min=24576, max=126976, per=1.37%, avg=68736.00, stdev=41556.19, samples=16 00:26:20.641 iops : min= 24, max= 124, avg=67.13, stdev=40.58, samples=16 00:26:20.641 lat (msec) : 100=0.15%, 250=0.90%, 500=1.35%, 750=0.45%, 1000=7.67% 00:26:20.641 lat (msec) : 2000=55.04%, >=2000=34.44% 00:26:20.641 cpu : usr=0.00%, sys=1.06%, ctx=1117, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.5% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.641 issued rwts: total=665,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731832: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=59, BW=59.5MiB/s (62.4MB/s)(607MiB/10194msec) 00:26:20.641 slat (usec): min=52, max=147753, avg=16584.05, stdev=24083.06 00:26:20.641 clat (msec): min=123, max=3032, avg=2006.16, stdev=768.54 00:26:20.641 lat (msec): min=220, max=3100, avg=2022.74, stdev=772.43 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 342], 5.00th=[ 531], 10.00th=[ 726], 20.00th=[ 1284], 00:26:20.641 | 30.00th=[ 1653], 40.00th=[ 1888], 50.00th=[ 2140], 60.00th=[ 2333], 00:26:20.641 | 70.00th=[ 2567], 80.00th=[ 2802], 90.00th=[ 2937], 95.00th=[ 2970], 00:26:20.641 | 99.00th=[ 3004], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], 00:26:20.641 | 99.99th=[ 3037] 00:26:20.641 bw ( KiB/s): min=24576, max=116736, per=1.15%, avg=57705.41, stdev=28481.52, samples=17 00:26:20.641 iops : min= 24, max= 114, avg=56.35, stdev=27.81, samples=17 00:26:20.641 lat (msec) : 250=0.33%, 500=4.28%, 750=5.77%, 1000=3.13%, 2000=31.80% 00:26:20.641 lat (msec) : >=2000=54.70% 00:26:20.641 cpu : usr=0.05%, sys=1.37%, ctx=1141, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.3%, >=64=89.6% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.641 issued rwts: total=607,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731833: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=60, BW=60.7MiB/s (63.7MB/s)(612MiB/10081msec) 00:26:20.641 slat (usec): min=56, max=204699, avg=16382.58, stdev=28065.55 00:26:20.641 clat (msec): min=52, max=2446, avg=1805.41, stdev=434.11 00:26:20.641 lat (msec): min=89, max=2450, avg=1821.79, stdev=433.47 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 161], 5.00th=[ 642], 10.00th=[ 1334], 20.00th=[ 1687], 00:26:20.641 | 30.00th=[ 1804], 40.00th=[ 1854], 50.00th=[ 1905], 60.00th=[ 1938], 00:26:20.641 | 70.00th=[ 1989], 80.00th=[ 2056], 90.00th=[ 2165], 95.00th=[ 2333], 00:26:20.641 | 99.00th=[ 2400], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], 00:26:20.641 | 99.99th=[ 2433] 00:26:20.641 bw ( KiB/s): min= 8192, max=81920, per=1.23%, avg=61952.00, stdev=19262.82, samples=16 00:26:20.641 iops : min= 8, max= 80, avg=60.50, stdev=18.81, samples=16 00:26:20.641 lat (msec) : 100=0.33%, 250=0.82%, 500=1.80%, 750=2.45%, 1000=2.29% 00:26:20.641 lat (msec) : 2000=63.89%, >=2000=28.43% 00:26:20.641 cpu : usr=0.02%, sys=1.04%, ctx=1193, majf=0, minf=32769 00:26:20.641 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.7% 00:26:20.641 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.641 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.641 issued rwts: total=612,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.641 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.641 job5: (groupid=0, jobs=1): err= 0: pid=731834: Wed Apr 24 15:27:22 2024 00:26:20.641 read: IOPS=77, BW=77.2MiB/s (80.9MB/s)(776MiB/10055msec) 00:26:20.641 slat (usec): min=37, max=135181, avg=12889.96, stdev=22953.22 00:26:20.641 clat (msec): min=49, max=2674, avg=1411.57, stdev=523.60 00:26:20.641 lat (msec): min=54, max=2687, avg=1424.46, stdev=526.82 00:26:20.641 clat percentiles (msec): 00:26:20.641 | 1.00th=[ 66], 5.00th=[ 409], 10.00th=[ 852], 20.00th=[ 1083], 00:26:20.641 | 30.00th=[ 1183], 40.00th=[ 1301], 50.00th=[ 1418], 60.00th=[ 1502], 00:26:20.641 | 70.00th=[ 1586], 80.00th=[ 1703], 90.00th=[ 2140], 95.00th=[ 2500], 00:26:20.641 | 99.00th=[ 2635], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], 00:26:20.641 | 99.99th=[ 2668] 00:26:20.641 bw ( KiB/s): min=36864, max=157696, per=1.77%, avg=88610.13, stdev=33629.51, samples=15 00:26:20.642 iops : min= 36, max= 154, avg=86.53, stdev=32.84, samples=15 00:26:20.642 lat (msec) : 50=0.13%, 100=1.68%, 250=1.55%, 500=3.09%, 750=2.19% 00:26:20.642 lat (msec) : 1000=7.35%, 2000=71.26%, >=2000=12.76% 00:26:20.642 cpu : usr=0.02%, sys=1.18%, ctx=1266, majf=0, minf=32769 00:26:20.642 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.1%, >=64=91.9% 00:26:20.642 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.642 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.642 issued rwts: total=776,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.642 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.642 job5: (groupid=0, jobs=1): err= 0: pid=731835: Wed Apr 24 15:27:22 2024 00:26:20.642 read: IOPS=74, BW=74.1MiB/s (77.7MB/s)(750MiB/10125msec) 00:26:20.642 slat (usec): min=44, max=125456, avg=13339.44, stdev=22290.26 00:26:20.642 clat (msec): min=117, max=2189, avg=1608.83, stdev=466.68 00:26:20.642 lat (msec): min=128, max=2202, avg=1622.17, stdev=467.77 00:26:20.642 clat percentiles (msec): 00:26:20.642 | 1.00th=[ 146], 5.00th=[ 684], 10.00th=[ 1020], 20.00th=[ 1167], 00:26:20.642 | 30.00th=[ 1401], 40.00th=[ 1703], 50.00th=[ 1770], 60.00th=[ 1838], 00:26:20.642 | 70.00th=[ 1938], 80.00th=[ 1989], 90.00th=[ 2056], 95.00th=[ 2106], 00:26:20.642 | 99.00th=[ 2165], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], 00:26:20.642 | 99.99th=[ 2198] 00:26:20.642 bw ( KiB/s): min=47104, max=98304, per=1.41%, avg=70883.56, stdev=14837.32, samples=18 00:26:20.642 iops : min= 46, max= 96, avg=69.22, stdev=14.49, samples=18 00:26:20.642 lat (msec) : 250=1.20%, 500=2.13%, 750=3.33%, 1000=2.40%, 2000=72.93% 00:26:20.642 lat (msec) : >=2000=18.00% 00:26:20.642 cpu : usr=0.01%, sys=1.39%, ctx=1156, majf=0, minf=32769 00:26:20.642 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.3%, >=64=91.6% 00:26:20.642 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:20.642 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:20.642 issued rwts: total=750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:20.642 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:20.642 00:26:20.642 Run status group 0 (all jobs): 00:26:20.642 READ: bw=4903MiB/s (5141MB/s), 37.3MiB/s-119MiB/s (39.1MB/s-124MB/s), io=48.8GiB (52.4GB), run=10053-10194msec 00:26:20.642 00:26:20.642 Disk stats (read/write): 00:26:20.642 nvme0n1: ios=67300/0, merge=0/0, ticks=8277229/0, in_queue=8277229, util=98.31% 00:26:20.642 nvme1n1: ios=64693/0, merge=0/0, ticks=8142200/0, in_queue=8142200, util=98.57% 00:26:20.642 nvme2n1: ios=67034/0, merge=0/0, ticks=8167037/0, in_queue=8167037, util=98.64% 00:26:20.642 nvme3n1: ios=65246/0, merge=0/0, ticks=7982596/0, in_queue=7982596, util=98.70% 00:26:20.642 nvme4n1: ios=62709/0, merge=0/0, ticks=7827086/0, in_queue=7827086, util=98.89% 00:26:20.642 nvme5n1: ios=66363/0, merge=0/0, ticks=8308753/0, in_queue=8308753, util=99.14% 00:26:20.642 15:27:23 -- target/srq_overwhelm.sh@38 -- # sync 00:26:20.642 15:27:23 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:26:20.642 15:27:23 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:20.642 15:27:23 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:26:20.642 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:26:20.642 15:27:24 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:26:20.642 15:27:24 -- common/autotest_common.sh@1205 -- # local i=0 00:26:20.642 15:27:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:20.642 15:27:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:26:20.642 15:27:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:20.642 15:27:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:26:20.642 15:27:24 -- common/autotest_common.sh@1217 -- # return 0 00:26:20.642 15:27:24 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:26:20.642 15:27:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.642 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:20.642 15:27:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.642 15:27:24 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:20.642 15:27:24 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:26:21.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:26:21.211 15:27:24 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:26:21.211 15:27:24 -- common/autotest_common.sh@1205 -- # local i=0 00:26:21.211 15:27:24 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:21.211 15:27:24 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:26:21.211 15:27:24 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:26:21.211 15:27:24 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:21.211 15:27:24 -- common/autotest_common.sh@1217 -- # return 0 00:26:21.211 15:27:24 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:21.211 15:27:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.211 15:27:24 -- common/autotest_common.sh@10 -- # set +x 00:26:21.211 15:27:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.211 15:27:25 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:21.211 15:27:25 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:26:22.149 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:26:22.149 15:27:25 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:26:22.149 15:27:25 -- common/autotest_common.sh@1205 -- # local i=0 00:26:22.149 15:27:25 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:22.149 15:27:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:26:22.149 15:27:25 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:26:22.149 15:27:25 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:22.149 15:27:25 -- common/autotest_common.sh@1217 -- # return 0 00:26:22.149 15:27:25 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:22.149 15:27:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.149 15:27:25 -- common/autotest_common.sh@10 -- # set +x 00:26:22.149 15:27:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.149 15:27:25 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:22.149 15:27:25 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:26:23.085 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:26:23.085 15:27:26 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:26:23.085 15:27:26 -- common/autotest_common.sh@1205 -- # local i=0 00:26:23.085 15:27:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:23.086 15:27:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:26:23.086 15:27:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:26:23.086 15:27:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:23.086 15:27:26 -- common/autotest_common.sh@1217 -- # return 0 00:26:23.086 15:27:26 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:26:23.086 15:27:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.086 15:27:26 -- common/autotest_common.sh@10 -- # set +x 00:26:23.086 15:27:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.086 15:27:26 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:23.086 15:27:26 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:26:24.064 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:26:24.064 15:27:27 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:26:24.064 15:27:27 -- common/autotest_common.sh@1205 -- # local i=0 00:26:24.064 15:27:27 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:24.064 15:27:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:26:24.064 15:27:27 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:24.064 15:27:27 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:26:24.064 15:27:27 -- common/autotest_common.sh@1217 -- # return 0 00:26:24.064 15:27:27 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:26:24.064 15:27:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:24.064 15:27:27 -- common/autotest_common.sh@10 -- # set +x 00:26:24.064 15:27:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:24.064 15:27:27 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:24.064 15:27:27 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:26:24.719 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:26:24.719 15:27:28 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:26:24.719 15:27:28 -- common/autotest_common.sh@1205 -- # local i=0 00:26:24.719 15:27:28 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:24.719 15:27:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:26:24.719 15:27:28 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:24.719 15:27:28 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:26:24.719 15:27:28 -- common/autotest_common.sh@1217 -- # return 0 00:26:24.719 15:27:28 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:26:24.719 15:27:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:24.719 15:27:28 -- common/autotest_common.sh@10 -- # set +x 00:26:24.719 15:27:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:24.719 15:27:28 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:26:24.719 15:27:28 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:26:24.719 15:27:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:24.719 15:27:28 -- nvmf/common.sh@117 -- # sync 00:26:24.719 15:27:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:24.719 15:27:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:24.719 15:27:28 -- nvmf/common.sh@120 -- # set +e 00:26:24.719 15:27:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:24.719 15:27:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:24.719 rmmod nvme_rdma 00:26:24.719 rmmod nvme_fabrics 00:26:24.719 15:27:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:24.979 15:27:28 -- nvmf/common.sh@124 -- # set -e 00:26:24.979 15:27:28 -- nvmf/common.sh@125 -- # return 0 00:26:24.979 15:27:28 -- nvmf/common.sh@478 -- # '[' -n 731080 ']' 00:26:24.979 15:27:28 -- nvmf/common.sh@479 -- # killprocess 731080 00:26:24.979 15:27:28 -- common/autotest_common.sh@936 -- # '[' -z 731080 ']' 00:26:24.979 15:27:28 -- common/autotest_common.sh@940 -- # kill -0 731080 00:26:24.979 15:27:28 -- common/autotest_common.sh@941 -- # uname 00:26:24.979 15:27:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:24.979 15:27:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 731080 00:26:24.979 15:27:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:24.979 15:27:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:24.979 15:27:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 731080' 00:26:24.979 killing process with pid 731080 00:26:24.979 15:27:28 -- common/autotest_common.sh@955 -- # kill 731080 00:26:24.979 15:27:28 -- common/autotest_common.sh@960 -- # wait 731080 00:26:24.979 [2024-04-24 15:27:28.718941] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:25.238 15:27:29 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:25.238 15:27:29 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:25.238 00:26:25.238 real 0m27.089s 00:26:25.238 user 1m24.050s 00:26:25.238 sys 0m17.214s 00:26:25.238 15:27:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:25.238 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:25.238 ************************************ 00:26:25.238 END TEST nvmf_srq_overwhelm 00:26:25.238 ************************************ 00:26:25.238 15:27:29 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:25.238 15:27:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:25.238 15:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:25.238 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:25.497 ************************************ 00:26:25.497 START TEST nvmf_shutdown 00:26:25.497 ************************************ 00:26:25.497 15:27:29 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:25.497 * Looking for test storage... 00:26:25.497 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target 00:26:25.498 15:27:29 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:26:25.498 15:27:29 -- nvmf/common.sh@7 -- # uname -s 00:26:25.498 15:27:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:25.498 15:27:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:25.498 15:27:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:25.498 15:27:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:25.498 15:27:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:25.498 15:27:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:25.498 15:27:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:25.498 15:27:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:25.498 15:27:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:25.498 15:27:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:25.498 15:27:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:26:25.498 15:27:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:26:25.498 15:27:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:25.498 15:27:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:25.498 15:27:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:25.498 15:27:29 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:25.498 15:27:29 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:26:25.498 15:27:29 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:25.498 15:27:29 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:25.498 15:27:29 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:25.498 15:27:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.498 15:27:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.498 15:27:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.498 15:27:29 -- paths/export.sh@5 -- # export PATH 00:26:25.498 15:27:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:25.498 15:27:29 -- nvmf/common.sh@47 -- # : 0 00:26:25.498 15:27:29 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:25.498 15:27:29 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:25.498 15:27:29 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:25.498 15:27:29 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:25.498 15:27:29 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:25.498 15:27:29 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:25.498 15:27:29 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:25.498 15:27:29 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:25.498 15:27:29 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:25.498 15:27:29 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:25.498 15:27:29 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:26:25.498 15:27:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:25.498 15:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:25.498 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:25.757 ************************************ 00:26:25.757 START TEST nvmf_shutdown_tc1 00:26:25.758 ************************************ 00:26:25.758 15:27:29 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:26:25.758 15:27:29 -- target/shutdown.sh@74 -- # starttarget 00:26:25.758 15:27:29 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:25.758 15:27:29 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:25.758 15:27:29 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:25.758 15:27:29 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:25.758 15:27:29 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:25.758 15:27:29 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:25.758 15:27:29 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:25.758 15:27:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:25.758 15:27:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:25.758 15:27:29 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:25.758 15:27:29 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:25.758 15:27:29 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:25.758 15:27:29 -- common/autotest_common.sh@10 -- # set +x 00:26:32.337 15:27:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:32.337 15:27:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:32.337 15:27:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:32.337 15:27:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:32.337 15:27:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:32.337 15:27:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:32.337 15:27:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:32.337 15:27:35 -- nvmf/common.sh@295 -- # net_devs=() 00:26:32.337 15:27:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:32.337 15:27:35 -- nvmf/common.sh@296 -- # e810=() 00:26:32.337 15:27:35 -- nvmf/common.sh@296 -- # local -ga e810 00:26:32.337 15:27:35 -- nvmf/common.sh@297 -- # x722=() 00:26:32.337 15:27:35 -- nvmf/common.sh@297 -- # local -ga x722 00:26:32.337 15:27:35 -- nvmf/common.sh@298 -- # mlx=() 00:26:32.337 15:27:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:32.337 15:27:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:32.337 15:27:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:32.337 15:27:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:32.337 15:27:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:32.337 15:27:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:32.338 15:27:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:26:32.338 Found 0000:18:00.0 (0x8086 - 0x1592) 00:26:32.338 15:27:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:32.338 15:27:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:26:32.338 Found 0000:18:00.1 (0x8086 - 0x1592) 00:26:32.338 15:27:35 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:32.338 15:27:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@377 -- # modinfo irdma 00:26:32.338 15:27:35 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:26:32.338 15:27:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:32.338 15:27:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:32.338 15:27:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:26:32.338 Found net devices under 0000:18:00.0: cvl_0_0 00:26:32.338 15:27:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:32.338 15:27:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:32.338 15:27:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:26:32.338 Found net devices under 0000:18:00.1: cvl_0_1 00:26:32.338 15:27:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:32.338 15:27:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:32.338 15:27:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:32.338 15:27:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:32.338 15:27:35 -- nvmf/common.sh@58 -- # uname 00:26:32.338 15:27:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:32.338 15:27:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:32.338 15:27:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:32.338 15:27:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:32.338 15:27:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:32.338 15:27:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:32.338 15:27:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:32.338 15:27:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:32.338 15:27:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:32.338 15:27:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:32.338 15:27:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:32.338 15:27:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:32.338 15:27:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:32.338 15:27:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:32.338 15:27:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:32.338 15:27:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:32.338 15:27:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:32.338 15:27:35 -- nvmf/common.sh@105 -- # continue 2 00:26:32.338 15:27:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:35 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:32.338 15:27:35 -- nvmf/common.sh@105 -- # continue 2 00:26:32.338 15:27:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:32.338 15:27:35 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:26:32.338 15:27:35 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:32.338 15:27:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:32.338 15:27:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:32.338 15:27:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:32.338 15:27:35 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:32.338 15:27:35 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:32.338 15:27:35 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:26:32.338 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:32.338 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:26:32.338 altname enp24s0f0np0 00:26:32.338 altname ens785f0np0 00:26:32.338 inet 192.168.100.8/24 scope global cvl_0_0 00:26:32.338 valid_lft forever preferred_lft forever 00:26:32.338 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:26:32.338 valid_lft forever preferred_lft forever 00:26:32.338 15:27:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:32.338 15:27:36 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:32.338 15:27:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:32.338 15:27:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:32.338 15:27:36 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:26:32.338 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:32.338 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:26:32.338 altname enp24s0f1np1 00:26:32.338 altname ens785f1np1 00:26:32.338 inet 192.168.100.9/24 scope global cvl_0_1 00:26:32.338 valid_lft forever preferred_lft forever 00:26:32.338 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:26:32.338 valid_lft forever preferred_lft forever 00:26:32.338 15:27:36 -- nvmf/common.sh@411 -- # return 0 00:26:32.338 15:27:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:32.338 15:27:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:32.338 15:27:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:32.338 15:27:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:32.338 15:27:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:32.338 15:27:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:32.338 15:27:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:32.338 15:27:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:32.338 15:27:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:32.338 15:27:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:32.338 15:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:32.338 15:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:32.338 15:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:36 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:32.338 15:27:36 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:32.338 15:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:32.338 15:27:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:32.338 15:27:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:32.338 15:27:36 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:32.338 15:27:36 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@105 -- # continue 2 00:26:32.338 15:27:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:32.338 15:27:36 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:26:32.338 15:27:36 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:32.338 15:27:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:32.338 15:27:36 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:32.338 15:27:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:32.338 15:27:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:32.338 192.168.100.9' 00:26:32.338 15:27:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:32.338 192.168.100.9' 00:26:32.338 15:27:36 -- nvmf/common.sh@446 -- # head -n 1 00:26:32.339 15:27:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:32.339 15:27:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:32.339 192.168.100.9' 00:26:32.339 15:27:36 -- nvmf/common.sh@447 -- # tail -n +2 00:26:32.339 15:27:36 -- nvmf/common.sh@447 -- # head -n 1 00:26:32.339 15:27:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:32.339 15:27:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:32.339 15:27:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:32.339 15:27:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:32.339 15:27:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:32.339 15:27:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:32.339 15:27:36 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:32.339 15:27:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:32.339 15:27:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:32.339 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:32.339 15:27:36 -- nvmf/common.sh@470 -- # nvmfpid=736939 00:26:32.339 15:27:36 -- nvmf/common.sh@471 -- # waitforlisten 736939 00:26:32.339 15:27:36 -- common/autotest_common.sh@817 -- # '[' -z 736939 ']' 00:26:32.339 15:27:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:32.339 15:27:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:32.339 15:27:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:32.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:32.339 15:27:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:32.339 15:27:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:32.339 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:32.339 [2024-04-24 15:27:36.169189] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:32.339 [2024-04-24 15:27:36.169254] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:32.339 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.599 [2024-04-24 15:27:36.253548] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:32.599 [2024-04-24 15:27:36.336074] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:32.599 [2024-04-24 15:27:36.336120] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:32.599 [2024-04-24 15:27:36.336130] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:32.599 [2024-04-24 15:27:36.336138] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:32.599 [2024-04-24 15:27:36.336144] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:32.599 [2024-04-24 15:27:36.336249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:32.599 [2024-04-24 15:27:36.336335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:32.599 [2024-04-24 15:27:36.336436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:32.599 [2024-04-24 15:27:36.336437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:33.168 15:27:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:33.168 15:27:36 -- common/autotest_common.sh@850 -- # return 0 00:26:33.168 15:27:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:33.168 15:27:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:33.168 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:26:33.168 15:27:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:33.168 15:27:37 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:33.168 15:27:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:33.168 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.168 [2024-04-24 15:27:37.048402] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1d88c00/0x1d88240) succeed. 00:26:33.168 [2024-04-24 15:27:37.058897] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1d89f70/0x1d887c0) succeed. 00:26:33.168 [2024-04-24 15:27:37.058921] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:26:33.168 15:27:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:33.168 15:27:37 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:33.168 15:27:37 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:33.168 15:27:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:33.168 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.168 15:27:37 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:33.168 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.168 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:33.428 15:27:37 -- target/shutdown.sh@28 -- # cat 00:26:33.428 15:27:37 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:33.428 15:27:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:33.428 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.428 Malloc1 00:26:33.428 [2024-04-24 15:27:37.176860] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:33.428 Malloc2 00:26:33.428 Malloc3 00:26:33.428 Malloc4 00:26:33.428 Malloc5 00:26:33.687 Malloc6 00:26:33.688 Malloc7 00:26:33.688 Malloc8 00:26:33.688 Malloc9 00:26:33.688 Malloc10 00:26:33.688 15:27:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:33.688 15:27:37 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:33.688 15:27:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:33.688 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.949 15:27:37 -- target/shutdown.sh@78 -- # perfpid=737234 00:26:33.949 15:27:37 -- target/shutdown.sh@79 -- # waitforlisten 737234 /var/tmp/bdevperf.sock 00:26:33.949 15:27:37 -- common/autotest_common.sh@817 -- # '[' -z 737234 ']' 00:26:33.949 15:27:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:33.949 15:27:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:33.949 15:27:37 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:26:33.949 15:27:37 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:33.949 15:27:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:33.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:33.949 15:27:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:33.949 15:27:37 -- nvmf/common.sh@521 -- # config=() 00:26:33.949 15:27:37 -- common/autotest_common.sh@10 -- # set +x 00:26:33.949 15:27:37 -- nvmf/common.sh@521 -- # local subsystem config 00:26:33.949 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.949 { 00:26:33.949 "params": { 00:26:33.949 "name": "Nvme$subsystem", 00:26:33.949 "trtype": "$TEST_TRANSPORT", 00:26:33.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.949 "adrfam": "ipv4", 00:26:33.949 "trsvcid": "$NVMF_PORT", 00:26:33.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.949 "hdgst": ${hdgst:-false}, 00:26:33.949 "ddgst": ${ddgst:-false} 00:26:33.949 }, 00:26:33.949 "method": "bdev_nvme_attach_controller" 00:26:33.949 } 00:26:33.949 EOF 00:26:33.949 )") 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.949 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.949 { 00:26:33.949 "params": { 00:26:33.949 "name": "Nvme$subsystem", 00:26:33.949 "trtype": "$TEST_TRANSPORT", 00:26:33.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.949 "adrfam": "ipv4", 00:26:33.949 "trsvcid": "$NVMF_PORT", 00:26:33.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.949 "hdgst": ${hdgst:-false}, 00:26:33.949 "ddgst": ${ddgst:-false} 00:26:33.949 }, 00:26:33.949 "method": "bdev_nvme_attach_controller" 00:26:33.949 } 00:26:33.949 EOF 00:26:33.949 )") 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.949 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.949 { 00:26:33.949 "params": { 00:26:33.949 "name": "Nvme$subsystem", 00:26:33.949 "trtype": "$TEST_TRANSPORT", 00:26:33.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.949 "adrfam": "ipv4", 00:26:33.949 "trsvcid": "$NVMF_PORT", 00:26:33.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.949 "hdgst": ${hdgst:-false}, 00:26:33.949 "ddgst": ${ddgst:-false} 00:26:33.949 }, 00:26:33.949 "method": "bdev_nvme_attach_controller" 00:26:33.949 } 00:26:33.949 EOF 00:26:33.949 )") 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.949 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.949 { 00:26:33.949 "params": { 00:26:33.949 "name": "Nvme$subsystem", 00:26:33.949 "trtype": "$TEST_TRANSPORT", 00:26:33.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.949 "adrfam": "ipv4", 00:26:33.949 "trsvcid": "$NVMF_PORT", 00:26:33.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.949 "hdgst": ${hdgst:-false}, 00:26:33.949 "ddgst": ${ddgst:-false} 00:26:33.949 }, 00:26:33.949 "method": "bdev_nvme_attach_controller" 00:26:33.949 } 00:26:33.949 EOF 00:26:33.949 )") 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.949 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.949 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.949 { 00:26:33.949 "params": { 00:26:33.949 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.950 { 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 [2024-04-24 15:27:37.685246] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:33.950 [2024-04-24 15:27:37.685301] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.950 { 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.950 { 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.950 { 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:33.950 { 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme$subsystem", 00:26:33.950 "trtype": "$TEST_TRANSPORT", 00:26:33.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "$NVMF_PORT", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:33.950 "hdgst": ${hdgst:-false}, 00:26:33.950 "ddgst": ${ddgst:-false} 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 } 00:26:33.950 EOF 00:26:33.950 )") 00:26:33.950 15:27:37 -- nvmf/common.sh@543 -- # cat 00:26:33.950 15:27:37 -- nvmf/common.sh@545 -- # jq . 00:26:33.950 15:27:37 -- nvmf/common.sh@546 -- # IFS=, 00:26:33.950 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.950 15:27:37 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme1", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme2", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme3", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme4", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme5", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme6", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme7", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.950 }, 00:26:33.950 "method": "bdev_nvme_attach_controller" 00:26:33.950 },{ 00:26:33.950 "params": { 00:26:33.950 "name": "Nvme8", 00:26:33.950 "trtype": "rdma", 00:26:33.950 "traddr": "192.168.100.8", 00:26:33.950 "adrfam": "ipv4", 00:26:33.950 "trsvcid": "4420", 00:26:33.950 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:33.950 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:33.950 "hdgst": false, 00:26:33.950 "ddgst": false 00:26:33.951 }, 00:26:33.951 "method": "bdev_nvme_attach_controller" 00:26:33.951 },{ 00:26:33.951 "params": { 00:26:33.951 "name": "Nvme9", 00:26:33.951 "trtype": "rdma", 00:26:33.951 "traddr": "192.168.100.8", 00:26:33.951 "adrfam": "ipv4", 00:26:33.951 "trsvcid": "4420", 00:26:33.951 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:33.951 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:33.951 "hdgst": false, 00:26:33.951 "ddgst": false 00:26:33.951 }, 00:26:33.951 "method": "bdev_nvme_attach_controller" 00:26:33.951 },{ 00:26:33.951 "params": { 00:26:33.951 "name": "Nvme10", 00:26:33.951 "trtype": "rdma", 00:26:33.951 "traddr": "192.168.100.8", 00:26:33.951 "adrfam": "ipv4", 00:26:33.951 "trsvcid": "4420", 00:26:33.951 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:33.951 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:33.951 "hdgst": false, 00:26:33.951 "ddgst": false 00:26:33.951 }, 00:26:33.951 "method": "bdev_nvme_attach_controller" 00:26:33.951 }' 00:26:33.951 [2024-04-24 15:27:37.770745] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.951 [2024-04-24 15:27:37.852334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:34.890 15:27:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:34.890 15:27:38 -- common/autotest_common.sh@850 -- # return 0 00:26:34.890 15:27:38 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:34.890 15:27:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:34.890 15:27:38 -- common/autotest_common.sh@10 -- # set +x 00:26:34.890 15:27:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:34.890 15:27:38 -- target/shutdown.sh@83 -- # kill -9 737234 00:26:34.890 15:27:38 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:26:34.890 15:27:38 -- target/shutdown.sh@87 -- # sleep 1 00:26:35.830 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 737234 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:26:35.830 15:27:39 -- target/shutdown.sh@88 -- # kill -0 736939 00:26:35.830 15:27:39 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:26:35.830 15:27:39 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:35.830 15:27:39 -- nvmf/common.sh@521 -- # config=() 00:26:35.830 15:27:39 -- nvmf/common.sh@521 -- # local subsystem config 00:26:35.830 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:35.830 { 00:26:35.830 "params": { 00:26:35.830 "name": "Nvme$subsystem", 00:26:35.830 "trtype": "$TEST_TRANSPORT", 00:26:35.830 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:35.830 "adrfam": "ipv4", 00:26:35.830 "trsvcid": "$NVMF_PORT", 00:26:35.830 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:35.830 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:35.830 "hdgst": ${hdgst:-false}, 00:26:35.830 "ddgst": ${ddgst:-false} 00:26:35.830 }, 00:26:35.830 "method": "bdev_nvme_attach_controller" 00:26:35.830 } 00:26:35.830 EOF 00:26:35.830 )") 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:35.830 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:35.830 { 00:26:35.830 "params": { 00:26:35.830 "name": "Nvme$subsystem", 00:26:35.830 "trtype": "$TEST_TRANSPORT", 00:26:35.830 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:35.830 "adrfam": "ipv4", 00:26:35.830 "trsvcid": "$NVMF_PORT", 00:26:35.830 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:35.830 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:35.830 "hdgst": ${hdgst:-false}, 00:26:35.830 "ddgst": ${ddgst:-false} 00:26:35.830 }, 00:26:35.830 "method": "bdev_nvme_attach_controller" 00:26:35.830 } 00:26:35.830 EOF 00:26:35.830 )") 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:35.830 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:35.830 { 00:26:35.830 "params": { 00:26:35.830 "name": "Nvme$subsystem", 00:26:35.830 "trtype": "$TEST_TRANSPORT", 00:26:35.830 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:35.830 "adrfam": "ipv4", 00:26:35.830 "trsvcid": "$NVMF_PORT", 00:26:35.830 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:35.830 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:35.830 "hdgst": ${hdgst:-false}, 00:26:35.830 "ddgst": ${ddgst:-false} 00:26:35.830 }, 00:26:35.830 "method": "bdev_nvme_attach_controller" 00:26:35.830 } 00:26:35.830 EOF 00:26:35.830 )") 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:35.830 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:35.830 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:35.830 { 00:26:35.830 "params": { 00:26:35.830 "name": "Nvme$subsystem", 00:26:35.830 "trtype": "$TEST_TRANSPORT", 00:26:35.830 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:35.830 "adrfam": "ipv4", 00:26:35.830 "trsvcid": "$NVMF_PORT", 00:26:35.830 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:35.830 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:35.830 "hdgst": ${hdgst:-false}, 00:26:35.830 "ddgst": ${ddgst:-false} 00:26:35.830 }, 00:26:35.830 "method": "bdev_nvme_attach_controller" 00:26:35.830 } 00:26:35.830 EOF 00:26:35.830 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 [2024-04-24 15:27:39.759908] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:36.090 [2024-04-24 15:27:39.759960] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid737484 ] 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:36.090 { 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme$subsystem", 00:26:36.090 "trtype": "$TEST_TRANSPORT", 00:26:36.090 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "$NVMF_PORT", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:36.090 "hdgst": ${hdgst:-false}, 00:26:36.090 "ddgst": ${ddgst:-false} 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 } 00:26:36.090 EOF 00:26:36.090 )") 00:26:36.090 15:27:39 -- nvmf/common.sh@543 -- # cat 00:26:36.090 15:27:39 -- nvmf/common.sh@545 -- # jq . 00:26:36.090 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.090 15:27:39 -- nvmf/common.sh@546 -- # IFS=, 00:26:36.090 15:27:39 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme1", 00:26:36.090 "trtype": "rdma", 00:26:36.090 "traddr": "192.168.100.8", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "4420", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:36.090 "hdgst": false, 00:26:36.090 "ddgst": false 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.090 },{ 00:26:36.090 "params": { 00:26:36.090 "name": "Nvme2", 00:26:36.090 "trtype": "rdma", 00:26:36.090 "traddr": "192.168.100.8", 00:26:36.090 "adrfam": "ipv4", 00:26:36.090 "trsvcid": "4420", 00:26:36.090 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:36.090 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:36.090 "hdgst": false, 00:26:36.090 "ddgst": false 00:26:36.090 }, 00:26:36.090 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme3", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme4", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme5", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme6", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme7", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme8", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme9", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 },{ 00:26:36.091 "params": { 00:26:36.091 "name": "Nvme10", 00:26:36.091 "trtype": "rdma", 00:26:36.091 "traddr": "192.168.100.8", 00:26:36.091 "adrfam": "ipv4", 00:26:36.091 "trsvcid": "4420", 00:26:36.091 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:36.091 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:36.091 "hdgst": false, 00:26:36.091 "ddgst": false 00:26:36.091 }, 00:26:36.091 "method": "bdev_nvme_attach_controller" 00:26:36.091 }' 00:26:36.091 [2024-04-24 15:27:39.843875] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:36.091 [2024-04-24 15:27:39.921749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:37.027 Running I/O for 1 seconds... 00:26:38.406 00:26:38.406 Latency(us) 00:26:38.406 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:38.406 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme1n1 : 1.17 381.49 23.84 0.00 0.00 164806.25 8605.16 166860.35 00:26:38.406 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme2n1 : 1.18 380.94 23.81 0.00 0.00 162889.02 9630.94 154095.08 00:26:38.406 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme3n1 : 1.18 380.39 23.77 0.00 0.00 160971.53 10656.72 134947.17 00:26:38.406 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme4n1 : 1.17 383.65 23.98 0.00 0.00 157390.33 5898.24 122181.90 00:26:38.406 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme5n1 : 1.18 380.06 23.75 0.00 0.00 155930.08 9289.02 125829.12 00:26:38.406 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme6n1 : 1.18 379.65 23.73 0.00 0.00 154233.54 9630.94 125829.12 00:26:38.406 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme7n1 : 1.18 379.21 23.70 0.00 0.00 152369.99 10143.83 112152.04 00:26:38.406 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme8n1 : 1.18 378.82 23.68 0.00 0.00 150009.00 10542.75 103945.79 00:26:38.406 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.406 Verification LBA range: start 0x0 length 0x400 00:26:38.406 Nvme9n1 : 1.18 378.29 23.64 0.00 0.00 148743.57 11340.58 103033.99 00:26:38.406 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:38.407 Verification LBA range: start 0x0 length 0x400 00:26:38.407 Nvme10n1 : 1.19 323.81 20.24 0.00 0.00 171107.06 8719.14 228863.11 00:26:38.407 =================================================================================================================== 00:26:38.407 Total : 3746.32 234.14 0.00 0.00 157652.83 5898.24 228863.11 00:26:38.407 15:27:42 -- target/shutdown.sh@94 -- # stoptarget 00:26:38.407 15:27:42 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:38.407 15:27:42 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:38.407 15:27:42 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:38.407 15:27:42 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:38.407 15:27:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:38.407 15:27:42 -- nvmf/common.sh@117 -- # sync 00:26:38.407 15:27:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:38.407 15:27:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:38.407 15:27:42 -- nvmf/common.sh@120 -- # set +e 00:26:38.407 15:27:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:38.407 15:27:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:38.407 rmmod nvme_rdma 00:26:38.407 rmmod nvme_fabrics 00:26:38.666 15:27:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:38.666 15:27:42 -- nvmf/common.sh@124 -- # set -e 00:26:38.666 15:27:42 -- nvmf/common.sh@125 -- # return 0 00:26:38.666 15:27:42 -- nvmf/common.sh@478 -- # '[' -n 736939 ']' 00:26:38.666 15:27:42 -- nvmf/common.sh@479 -- # killprocess 736939 00:26:38.666 15:27:42 -- common/autotest_common.sh@936 -- # '[' -z 736939 ']' 00:26:38.666 15:27:42 -- common/autotest_common.sh@940 -- # kill -0 736939 00:26:38.666 15:27:42 -- common/autotest_common.sh@941 -- # uname 00:26:38.666 15:27:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:38.666 15:27:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 736939 00:26:38.666 15:27:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:38.666 15:27:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:38.666 15:27:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 736939' 00:26:38.666 killing process with pid 736939 00:26:38.666 15:27:42 -- common/autotest_common.sh@955 -- # kill 736939 00:26:38.666 15:27:42 -- common/autotest_common.sh@960 -- # wait 736939 00:26:38.666 [2024-04-24 15:27:42.425874] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:39.235 15:27:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:39.235 15:27:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:39.235 00:26:39.235 real 0m13.384s 00:26:39.235 user 0m30.922s 00:26:39.235 sys 0m6.499s 00:26:39.235 15:27:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:39.235 15:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:39.235 ************************************ 00:26:39.235 END TEST nvmf_shutdown_tc1 00:26:39.235 ************************************ 00:26:39.235 15:27:42 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:26:39.235 15:27:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:39.235 15:27:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:39.235 15:27:42 -- common/autotest_common.sh@10 -- # set +x 00:26:39.235 ************************************ 00:26:39.235 START TEST nvmf_shutdown_tc2 00:26:39.235 ************************************ 00:26:39.235 15:27:43 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:26:39.235 15:27:43 -- target/shutdown.sh@99 -- # starttarget 00:26:39.235 15:27:43 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:39.235 15:27:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:39.235 15:27:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:39.235 15:27:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:39.235 15:27:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:39.235 15:27:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:39.235 15:27:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:39.235 15:27:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:39.235 15:27:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:39.235 15:27:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:39.235 15:27:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:39.235 15:27:43 -- common/autotest_common.sh@10 -- # set +x 00:26:39.235 15:27:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:39.235 15:27:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:39.235 15:27:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:39.235 15:27:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:39.235 15:27:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:39.235 15:27:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:39.235 15:27:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:39.235 15:27:43 -- nvmf/common.sh@295 -- # net_devs=() 00:26:39.235 15:27:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:39.235 15:27:43 -- nvmf/common.sh@296 -- # e810=() 00:26:39.235 15:27:43 -- nvmf/common.sh@296 -- # local -ga e810 00:26:39.235 15:27:43 -- nvmf/common.sh@297 -- # x722=() 00:26:39.235 15:27:43 -- nvmf/common.sh@297 -- # local -ga x722 00:26:39.235 15:27:43 -- nvmf/common.sh@298 -- # mlx=() 00:26:39.235 15:27:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:39.235 15:27:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:39.235 15:27:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:39.235 15:27:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:26:39.235 Found 0000:18:00.0 (0x8086 - 0x1592) 00:26:39.235 15:27:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:39.235 15:27:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:39.235 15:27:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:26:39.235 Found 0000:18:00.1 (0x8086 - 0x1592) 00:26:39.235 15:27:43 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:39.235 15:27:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@377 -- # modinfo irdma 00:26:39.235 15:27:43 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:26:39.235 15:27:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:39.235 15:27:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.235 15:27:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.235 15:27:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:26:39.235 Found net devices under 0000:18:00.0: cvl_0_0 00:26:39.235 15:27:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:39.235 15:27:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.235 15:27:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.235 15:27:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:26:39.235 Found net devices under 0000:18:00.1: cvl_0_1 00:26:39.235 15:27:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.235 15:27:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:39.235 15:27:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:39.235 15:27:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:39.235 15:27:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:39.235 15:27:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:39.235 15:27:43 -- nvmf/common.sh@58 -- # uname 00:26:39.235 15:27:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:39.235 15:27:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:39.235 15:27:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:39.495 15:27:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:39.495 15:27:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:39.495 15:27:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:39.495 15:27:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:39.495 15:27:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:39.495 15:27:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:39.495 15:27:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:39.495 15:27:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:39.495 15:27:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:39.495 15:27:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:39.495 15:27:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:39.495 15:27:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:39.495 15:27:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:39.495 15:27:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@105 -- # continue 2 00:26:39.495 15:27:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@105 -- # continue 2 00:26:39.495 15:27:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:39.495 15:27:43 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:39.495 15:27:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:39.495 15:27:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:26:39.495 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:39.495 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:26:39.495 altname enp24s0f0np0 00:26:39.495 altname ens785f0np0 00:26:39.495 inet 192.168.100.8/24 scope global cvl_0_0 00:26:39.495 valid_lft forever preferred_lft forever 00:26:39.495 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:26:39.495 valid_lft forever preferred_lft forever 00:26:39.495 15:27:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:39.495 15:27:43 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:39.495 15:27:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:39.495 15:27:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:26:39.495 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:39.495 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:26:39.495 altname enp24s0f1np1 00:26:39.495 altname ens785f1np1 00:26:39.495 inet 192.168.100.9/24 scope global cvl_0_1 00:26:39.495 valid_lft forever preferred_lft forever 00:26:39.495 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:26:39.495 valid_lft forever preferred_lft forever 00:26:39.495 15:27:43 -- nvmf/common.sh@411 -- # return 0 00:26:39.495 15:27:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:39.495 15:27:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:39.495 15:27:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:39.495 15:27:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:39.495 15:27:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:39.495 15:27:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:39.495 15:27:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:39.495 15:27:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:39.495 15:27:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:39.495 15:27:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@105 -- # continue 2 00:26:39.495 15:27:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:39.495 15:27:43 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:39.495 15:27:43 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@105 -- # continue 2 00:26:39.495 15:27:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:39.495 15:27:43 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:39.495 15:27:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:39.495 15:27:43 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:39.495 15:27:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:39.495 15:27:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:39.495 192.168.100.9' 00:26:39.495 15:27:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:39.495 192.168.100.9' 00:26:39.495 15:27:43 -- nvmf/common.sh@446 -- # head -n 1 00:26:39.495 15:27:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:39.495 15:27:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:39.495 192.168.100.9' 00:26:39.495 15:27:43 -- nvmf/common.sh@447 -- # tail -n +2 00:26:39.495 15:27:43 -- nvmf/common.sh@447 -- # head -n 1 00:26:39.495 15:27:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:39.495 15:27:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:39.495 15:27:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:39.495 15:27:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:39.495 15:27:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:39.495 15:27:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:39.495 15:27:43 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:39.495 15:27:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:39.495 15:27:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:39.495 15:27:43 -- common/autotest_common.sh@10 -- # set +x 00:26:39.495 15:27:43 -- nvmf/common.sh@470 -- # nvmfpid=738115 00:26:39.495 15:27:43 -- nvmf/common.sh@471 -- # waitforlisten 738115 00:26:39.495 15:27:43 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:39.495 15:27:43 -- common/autotest_common.sh@817 -- # '[' -z 738115 ']' 00:26:39.495 15:27:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:39.495 15:27:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:39.495 15:27:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:39.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:39.495 15:27:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:39.495 15:27:43 -- common/autotest_common.sh@10 -- # set +x 00:26:39.495 [2024-04-24 15:27:43.406881] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:39.495 [2024-04-24 15:27:43.406946] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:39.754 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.754 [2024-04-24 15:27:43.488504] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:39.754 [2024-04-24 15:27:43.569860] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:39.754 [2024-04-24 15:27:43.569899] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:39.754 [2024-04-24 15:27:43.569909] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:39.754 [2024-04-24 15:27:43.569917] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:39.754 [2024-04-24 15:27:43.569923] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:39.754 [2024-04-24 15:27:43.570027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:39.754 [2024-04-24 15:27:43.570100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:39.754 [2024-04-24 15:27:43.570199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:39.754 [2024-04-24 15:27:43.570200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:40.321 15:27:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:40.321 15:27:44 -- common/autotest_common.sh@850 -- # return 0 00:26:40.321 15:27:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:40.321 15:27:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:40.321 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:40.580 15:27:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.580 15:27:44 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:40.580 15:27:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:40.581 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:40.581 [2024-04-24 15:27:44.288774] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x5fac00/0x5fa240) succeed. 00:26:40.581 [2024-04-24 15:27:44.299188] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x5fbf70/0x5fa7c0) succeed. 00:26:40.581 [2024-04-24 15:27:44.299212] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:26:40.581 15:27:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:40.581 15:27:44 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:40.581 15:27:44 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:40.581 15:27:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:40.581 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:40.581 15:27:44 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:40.581 15:27:44 -- target/shutdown.sh@28 -- # cat 00:26:40.581 15:27:44 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:40.581 15:27:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:40.581 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:40.581 Malloc1 00:26:40.581 [2024-04-24 15:27:44.417289] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:40.581 Malloc2 00:26:40.581 Malloc3 00:26:40.840 Malloc4 00:26:40.840 Malloc5 00:26:40.840 Malloc6 00:26:40.840 Malloc7 00:26:40.840 Malloc8 00:26:41.100 Malloc9 00:26:41.100 Malloc10 00:26:41.100 15:27:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:41.100 15:27:44 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:41.100 15:27:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:41.100 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:41.100 15:27:44 -- target/shutdown.sh@103 -- # perfpid=738345 00:26:41.100 15:27:44 -- target/shutdown.sh@104 -- # waitforlisten 738345 /var/tmp/bdevperf.sock 00:26:41.100 15:27:44 -- common/autotest_common.sh@817 -- # '[' -z 738345 ']' 00:26:41.100 15:27:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:41.100 15:27:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:41.100 15:27:44 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:41.100 15:27:44 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:41.100 15:27:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:41.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:41.100 15:27:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:41.100 15:27:44 -- nvmf/common.sh@521 -- # config=() 00:26:41.100 15:27:44 -- common/autotest_common.sh@10 -- # set +x 00:26:41.100 15:27:44 -- nvmf/common.sh@521 -- # local subsystem config 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 [2024-04-24 15:27:44.937163] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:41.101 [2024-04-24 15:27:44.937233] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid738345 ] 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 15:27:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:41.101 { 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme$subsystem", 00:26:41.101 "trtype": "$TEST_TRANSPORT", 00:26:41.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "$NVMF_PORT", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:41.101 "hdgst": ${hdgst:-false}, 00:26:41.101 "ddgst": ${ddgst:-false} 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 } 00:26:41.101 EOF 00:26:41.101 )") 00:26:41.101 15:27:44 -- nvmf/common.sh@543 -- # cat 00:26:41.101 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.101 15:27:44 -- nvmf/common.sh@545 -- # jq . 00:26:41.101 15:27:44 -- nvmf/common.sh@546 -- # IFS=, 00:26:41.101 15:27:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme1", 00:26:41.101 "trtype": "rdma", 00:26:41.101 "traddr": "192.168.100.8", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "4420", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:41.101 "hdgst": false, 00:26:41.101 "ddgst": false 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 },{ 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme2", 00:26:41.101 "trtype": "rdma", 00:26:41.101 "traddr": "192.168.100.8", 00:26:41.101 "adrfam": "ipv4", 00:26:41.101 "trsvcid": "4420", 00:26:41.101 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:41.101 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:41.101 "hdgst": false, 00:26:41.101 "ddgst": false 00:26:41.101 }, 00:26:41.101 "method": "bdev_nvme_attach_controller" 00:26:41.101 },{ 00:26:41.101 "params": { 00:26:41.101 "name": "Nvme3", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme4", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme5", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme6", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme7", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme8", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme9", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 },{ 00:26:41.102 "params": { 00:26:41.102 "name": "Nvme10", 00:26:41.102 "trtype": "rdma", 00:26:41.102 "traddr": "192.168.100.8", 00:26:41.102 "adrfam": "ipv4", 00:26:41.102 "trsvcid": "4420", 00:26:41.102 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:41.102 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:41.102 "hdgst": false, 00:26:41.102 "ddgst": false 00:26:41.102 }, 00:26:41.102 "method": "bdev_nvme_attach_controller" 00:26:41.102 }' 00:26:41.360 [2024-04-24 15:27:45.022166] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.360 [2024-04-24 15:27:45.099481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:42.296 Running I/O for 10 seconds... 00:26:42.296 15:27:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:42.296 15:27:45 -- common/autotest_common.sh@850 -- # return 0 00:26:42.296 15:27:45 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:42.296 15:27:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:42.296 15:27:45 -- common/autotest_common.sh@10 -- # set +x 00:26:42.296 15:27:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:42.296 15:27:46 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:42.296 15:27:46 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:42.296 15:27:46 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:42.296 15:27:46 -- target/shutdown.sh@57 -- # local ret=1 00:26:42.296 15:27:46 -- target/shutdown.sh@58 -- # local i 00:26:42.296 15:27:46 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:42.296 15:27:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:42.296 15:27:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:42.296 15:27:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:42.296 15:27:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:42.296 15:27:46 -- common/autotest_common.sh@10 -- # set +x 00:26:42.556 15:27:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:42.556 15:27:46 -- target/shutdown.sh@60 -- # read_io_count=3 00:26:42.556 15:27:46 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:26:42.556 15:27:46 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:42.814 15:27:46 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:42.814 15:27:46 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:42.814 15:27:46 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:42.814 15:27:46 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:42.814 15:27:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:42.814 15:27:46 -- common/autotest_common.sh@10 -- # set +x 00:26:42.814 15:27:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:42.814 15:27:46 -- target/shutdown.sh@60 -- # read_io_count=195 00:26:42.814 15:27:46 -- target/shutdown.sh@63 -- # '[' 195 -ge 100 ']' 00:26:42.814 15:27:46 -- target/shutdown.sh@64 -- # ret=0 00:26:42.814 15:27:46 -- target/shutdown.sh@65 -- # break 00:26:42.814 15:27:46 -- target/shutdown.sh@69 -- # return 0 00:26:42.814 15:27:46 -- target/shutdown.sh@110 -- # killprocess 738345 00:26:42.814 15:27:46 -- common/autotest_common.sh@936 -- # '[' -z 738345 ']' 00:26:42.814 15:27:46 -- common/autotest_common.sh@940 -- # kill -0 738345 00:26:42.814 15:27:46 -- common/autotest_common.sh@941 -- # uname 00:26:42.814 15:27:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:42.814 15:27:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738345 00:26:43.074 15:27:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:43.074 15:27:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:43.074 15:27:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738345' 00:26:43.074 killing process with pid 738345 00:26:43.074 15:27:46 -- common/autotest_common.sh@955 -- # kill 738345 00:26:43.074 15:27:46 -- common/autotest_common.sh@960 -- # wait 738345 00:26:43.074 Received shutdown signal, test time was about 0.854538 seconds 00:26:43.074 00:26:43.074 Latency(us) 00:26:43.074 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.074 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme1n1 : 0.84 379.33 23.71 0.00 0.00 164285.75 9118.05 165036.74 00:26:43.074 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme2n1 : 0.85 378.58 23.66 0.00 0.00 161601.45 10143.83 152271.47 00:26:43.074 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme3n1 : 0.84 382.87 23.93 0.00 0.00 156676.90 6810.05 134947.17 00:26:43.074 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme4n1 : 0.85 381.80 23.86 0.00 0.00 152626.98 8434.20 120358.29 00:26:43.074 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme5n1 : 0.85 377.92 23.62 0.00 0.00 151286.56 8149.26 140418.00 00:26:43.074 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme6n1 : 0.85 377.37 23.59 0.00 0.00 149334.82 8434.20 145888.83 00:26:43.074 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme7n1 : 0.85 376.85 23.55 0.00 0.00 146344.03 8719.14 132211.76 00:26:43.074 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme8n1 : 0.85 376.35 23.52 0.00 0.00 143442.01 8947.09 125829.12 00:26:43.074 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme9n1 : 0.85 375.62 23.48 0.00 0.00 141726.41 9744.92 119446.48 00:26:43.074 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:43.074 Verification LBA range: start 0x0 length 0x400 00:26:43.074 Nvme10n1 : 0.85 299.94 18.75 0.00 0.00 173497.77 9232.03 255305.46 00:26:43.074 =================================================================================================================== 00:26:43.074 Total : 3706.63 231.66 0.00 0.00 153685.02 6810.05 255305.46 00:26:43.332 15:27:47 -- target/shutdown.sh@113 -- # sleep 1 00:26:44.270 15:27:48 -- target/shutdown.sh@114 -- # kill -0 738115 00:26:44.270 15:27:48 -- target/shutdown.sh@116 -- # stoptarget 00:26:44.270 15:27:48 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:44.270 15:27:48 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:44.270 15:27:48 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:44.270 15:27:48 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:44.270 15:27:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:44.270 15:27:48 -- nvmf/common.sh@117 -- # sync 00:26:44.270 15:27:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:44.270 15:27:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:44.270 15:27:48 -- nvmf/common.sh@120 -- # set +e 00:26:44.270 15:27:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:44.270 15:27:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:44.270 rmmod nvme_rdma 00:26:44.270 rmmod nvme_fabrics 00:26:44.270 15:27:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:44.270 15:27:48 -- nvmf/common.sh@124 -- # set -e 00:26:44.270 15:27:48 -- nvmf/common.sh@125 -- # return 0 00:26:44.270 15:27:48 -- nvmf/common.sh@478 -- # '[' -n 738115 ']' 00:26:44.270 15:27:48 -- nvmf/common.sh@479 -- # killprocess 738115 00:26:44.270 15:27:48 -- common/autotest_common.sh@936 -- # '[' -z 738115 ']' 00:26:44.270 15:27:48 -- common/autotest_common.sh@940 -- # kill -0 738115 00:26:44.270 15:27:48 -- common/autotest_common.sh@941 -- # uname 00:26:44.270 15:27:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:44.529 15:27:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738115 00:26:44.529 15:27:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:44.529 15:27:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:44.529 15:27:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738115' 00:26:44.529 killing process with pid 738115 00:26:44.529 15:27:48 -- common/autotest_common.sh@955 -- # kill 738115 00:26:44.529 15:27:48 -- common/autotest_common.sh@960 -- # wait 738115 00:26:44.529 [2024-04-24 15:27:48.256978] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:45.099 15:27:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:45.099 15:27:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:45.099 00:26:45.099 real 0m5.625s 00:26:45.099 user 0m22.633s 00:26:45.099 sys 0m1.317s 00:26:45.099 15:27:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:45.099 15:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:45.099 ************************************ 00:26:45.099 END TEST nvmf_shutdown_tc2 00:26:45.099 ************************************ 00:26:45.099 15:27:48 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:26:45.099 15:27:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:45.099 15:27:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:45.099 15:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:45.099 ************************************ 00:26:45.099 START TEST nvmf_shutdown_tc3 00:26:45.099 ************************************ 00:26:45.099 15:27:48 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:26:45.099 15:27:48 -- target/shutdown.sh@121 -- # starttarget 00:26:45.099 15:27:48 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:45.099 15:27:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:45.099 15:27:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:45.099 15:27:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:45.099 15:27:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:45.099 15:27:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:45.099 15:27:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:45.099 15:27:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:45.099 15:27:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:45.099 15:27:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:45.099 15:27:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:45.099 15:27:48 -- common/autotest_common.sh@10 -- # set +x 00:26:45.099 15:27:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:45.099 15:27:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:45.099 15:27:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:45.099 15:27:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:45.099 15:27:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:45.099 15:27:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:45.099 15:27:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:45.099 15:27:48 -- nvmf/common.sh@295 -- # net_devs=() 00:26:45.099 15:27:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:45.099 15:27:48 -- nvmf/common.sh@296 -- # e810=() 00:26:45.099 15:27:48 -- nvmf/common.sh@296 -- # local -ga e810 00:26:45.099 15:27:48 -- nvmf/common.sh@297 -- # x722=() 00:26:45.099 15:27:48 -- nvmf/common.sh@297 -- # local -ga x722 00:26:45.099 15:27:48 -- nvmf/common.sh@298 -- # mlx=() 00:26:45.099 15:27:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:45.099 15:27:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:45.099 15:27:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:45.099 15:27:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:26:45.099 Found 0000:18:00.0 (0x8086 - 0x1592) 00:26:45.099 15:27:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:45.099 15:27:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:45.099 15:27:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:26:45.099 Found 0000:18:00.1 (0x8086 - 0x1592) 00:26:45.099 15:27:48 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:45.099 15:27:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@377 -- # modinfo irdma 00:26:45.099 15:27:48 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:26:45.099 15:27:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:45.099 15:27:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.099 15:27:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.099 15:27:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:26:45.099 Found net devices under 0000:18:00.0: cvl_0_0 00:26:45.099 15:27:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:45.099 15:27:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:45.099 15:27:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:45.099 15:27:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:26:45.099 Found net devices under 0000:18:00.1: cvl_0_1 00:26:45.099 15:27:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:45.099 15:27:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:45.099 15:27:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:45.099 15:27:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:45.099 15:27:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:45.099 15:27:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:45.099 15:27:48 -- nvmf/common.sh@58 -- # uname 00:26:45.099 15:27:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:45.099 15:27:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:45.099 15:27:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:45.099 15:27:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:45.099 15:27:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:45.099 15:27:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:45.359 15:27:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:45.360 15:27:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:45.360 15:27:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:45.360 15:27:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:45.360 15:27:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:45.360 15:27:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:45.360 15:27:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:45.360 15:27:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:45.360 15:27:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:45.360 15:27:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:45.360 15:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@105 -- # continue 2 00:26:45.360 15:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@105 -- # continue 2 00:26:45.360 15:27:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:45.360 15:27:49 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:45.360 15:27:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:45.360 15:27:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:26:45.360 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:45.360 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:26:45.360 altname enp24s0f0np0 00:26:45.360 altname ens785f0np0 00:26:45.360 inet 192.168.100.8/24 scope global cvl_0_0 00:26:45.360 valid_lft forever preferred_lft forever 00:26:45.360 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:26:45.360 valid_lft forever preferred_lft forever 00:26:45.360 15:27:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:45.360 15:27:49 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:45.360 15:27:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:45.360 15:27:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:26:45.360 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:45.360 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:26:45.360 altname enp24s0f1np1 00:26:45.360 altname ens785f1np1 00:26:45.360 inet 192.168.100.9/24 scope global cvl_0_1 00:26:45.360 valid_lft forever preferred_lft forever 00:26:45.360 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:26:45.360 valid_lft forever preferred_lft forever 00:26:45.360 15:27:49 -- nvmf/common.sh@411 -- # return 0 00:26:45.360 15:27:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:45.360 15:27:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:45.360 15:27:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:45.360 15:27:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:45.360 15:27:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:45.360 15:27:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:45.360 15:27:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:45.360 15:27:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:45.360 15:27:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:45.360 15:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@105 -- # continue 2 00:26:45.360 15:27:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:45.360 15:27:49 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:45.360 15:27:49 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@105 -- # continue 2 00:26:45.360 15:27:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:45.360 15:27:49 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:45.360 15:27:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:45.360 15:27:49 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:45.360 15:27:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:45.360 15:27:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:45.360 192.168.100.9' 00:26:45.360 15:27:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:45.360 192.168.100.9' 00:26:45.360 15:27:49 -- nvmf/common.sh@446 -- # head -n 1 00:26:45.360 15:27:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:45.360 15:27:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:45.360 192.168.100.9' 00:26:45.360 15:27:49 -- nvmf/common.sh@447 -- # tail -n +2 00:26:45.360 15:27:49 -- nvmf/common.sh@447 -- # head -n 1 00:26:45.360 15:27:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:45.360 15:27:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:45.360 15:27:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:45.360 15:27:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:45.360 15:27:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:45.360 15:27:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:45.360 15:27:49 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:45.360 15:27:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:45.360 15:27:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:45.360 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:45.360 15:27:49 -- nvmf/common.sh@470 -- # nvmfpid=738999 00:26:45.360 15:27:49 -- nvmf/common.sh@471 -- # waitforlisten 738999 00:26:45.360 15:27:49 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:45.360 15:27:49 -- common/autotest_common.sh@817 -- # '[' -z 738999 ']' 00:26:45.360 15:27:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:45.360 15:27:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:45.360 15:27:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:45.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:45.360 15:27:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:45.360 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:26:45.360 [2024-04-24 15:27:49.224264] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:45.360 [2024-04-24 15:27:49.224321] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:45.360 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.620 [2024-04-24 15:27:49.302835] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:45.620 [2024-04-24 15:27:49.385211] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:45.620 [2024-04-24 15:27:49.385253] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:45.620 [2024-04-24 15:27:49.385263] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:45.620 [2024-04-24 15:27:49.385271] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:45.620 [2024-04-24 15:27:49.385278] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:45.620 [2024-04-24 15:27:49.385376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:45.620 [2024-04-24 15:27:49.385453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:45.620 [2024-04-24 15:27:49.385561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:45.620 [2024-04-24 15:27:49.385562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:46.190 15:27:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:46.190 15:27:50 -- common/autotest_common.sh@850 -- # return 0 00:26:46.190 15:27:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:46.190 15:27:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:46.190 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.190 15:27:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:46.190 15:27:50 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:46.190 15:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:46.190 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.190 [2024-04-24 15:27:50.101124] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1709c00/0x1709240) succeed. 00:26:46.450 [2024-04-24 15:27:50.111494] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x170af70/0x17097c0) succeed. 00:26:46.450 [2024-04-24 15:27:50.111517] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:26:46.450 15:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:46.450 15:27:50 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:46.450 15:27:50 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:46.450 15:27:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:46.450 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.450 15:27:50 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:46.450 15:27:50 -- target/shutdown.sh@28 -- # cat 00:26:46.450 15:27:50 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:46.450 15:27:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:46.450 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.450 Malloc1 00:26:46.450 [2024-04-24 15:27:50.228879] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:46.450 Malloc2 00:26:46.450 Malloc3 00:26:46.450 Malloc4 00:26:46.710 Malloc5 00:26:46.710 Malloc6 00:26:46.710 Malloc7 00:26:46.710 Malloc8 00:26:46.710 Malloc9 00:26:46.710 Malloc10 00:26:46.971 15:27:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:46.971 15:27:50 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:46.971 15:27:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:46.971 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.971 15:27:50 -- target/shutdown.sh@125 -- # perfpid=739222 00:26:46.971 15:27:50 -- target/shutdown.sh@126 -- # waitforlisten 739222 /var/tmp/bdevperf.sock 00:26:46.971 15:27:50 -- common/autotest_common.sh@817 -- # '[' -z 739222 ']' 00:26:46.971 15:27:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:46.971 15:27:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:46.971 15:27:50 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:46.971 15:27:50 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:46.971 15:27:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:46.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:46.971 15:27:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:46.971 15:27:50 -- nvmf/common.sh@521 -- # config=() 00:26:46.971 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:46.971 15:27:50 -- nvmf/common.sh@521 -- # local subsystem config 00:26:46.971 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.971 { 00:26:46.971 "params": { 00:26:46.971 "name": "Nvme$subsystem", 00:26:46.971 "trtype": "$TEST_TRANSPORT", 00:26:46.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.971 "adrfam": "ipv4", 00:26:46.971 "trsvcid": "$NVMF_PORT", 00:26:46.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.971 "hdgst": ${hdgst:-false}, 00:26:46.971 "ddgst": ${ddgst:-false} 00:26:46.971 }, 00:26:46.971 "method": "bdev_nvme_attach_controller" 00:26:46.971 } 00:26:46.971 EOF 00:26:46.971 )") 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.971 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.971 { 00:26:46.971 "params": { 00:26:46.971 "name": "Nvme$subsystem", 00:26:46.971 "trtype": "$TEST_TRANSPORT", 00:26:46.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.971 "adrfam": "ipv4", 00:26:46.971 "trsvcid": "$NVMF_PORT", 00:26:46.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.971 "hdgst": ${hdgst:-false}, 00:26:46.971 "ddgst": ${ddgst:-false} 00:26:46.971 }, 00:26:46.971 "method": "bdev_nvme_attach_controller" 00:26:46.971 } 00:26:46.971 EOF 00:26:46.971 )") 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.971 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.971 { 00:26:46.971 "params": { 00:26:46.971 "name": "Nvme$subsystem", 00:26:46.971 "trtype": "$TEST_TRANSPORT", 00:26:46.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.971 "adrfam": "ipv4", 00:26:46.971 "trsvcid": "$NVMF_PORT", 00:26:46.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.971 "hdgst": ${hdgst:-false}, 00:26:46.971 "ddgst": ${ddgst:-false} 00:26:46.971 }, 00:26:46.971 "method": "bdev_nvme_attach_controller" 00:26:46.971 } 00:26:46.971 EOF 00:26:46.971 )") 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.971 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.971 { 00:26:46.971 "params": { 00:26:46.971 "name": "Nvme$subsystem", 00:26:46.971 "trtype": "$TEST_TRANSPORT", 00:26:46.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.971 "adrfam": "ipv4", 00:26:46.971 "trsvcid": "$NVMF_PORT", 00:26:46.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.971 "hdgst": ${hdgst:-false}, 00:26:46.971 "ddgst": ${ddgst:-false} 00:26:46.971 }, 00:26:46.971 "method": "bdev_nvme_attach_controller" 00:26:46.971 } 00:26:46.971 EOF 00:26:46.971 )") 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.971 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.971 { 00:26:46.971 "params": { 00:26:46.971 "name": "Nvme$subsystem", 00:26:46.971 "trtype": "$TEST_TRANSPORT", 00:26:46.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.971 "adrfam": "ipv4", 00:26:46.971 "trsvcid": "$NVMF_PORT", 00:26:46.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.971 "hdgst": ${hdgst:-false}, 00:26:46.971 "ddgst": ${ddgst:-false} 00:26:46.971 }, 00:26:46.971 "method": "bdev_nvme_attach_controller" 00:26:46.971 } 00:26:46.971 EOF 00:26:46.971 )") 00:26:46.971 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.971 [2024-04-24 15:27:50.732328] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:46.972 [2024-04-24 15:27:50.732386] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid7392 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.972 22 ] 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.972 { 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme$subsystem", 00:26:46.972 "trtype": "$TEST_TRANSPORT", 00:26:46.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "$NVMF_PORT", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.972 "hdgst": ${hdgst:-false}, 00:26:46.972 "ddgst": ${ddgst:-false} 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 } 00:26:46.972 EOF 00:26:46.972 )") 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.972 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.972 { 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme$subsystem", 00:26:46.972 "trtype": "$TEST_TRANSPORT", 00:26:46.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "$NVMF_PORT", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.972 "hdgst": ${hdgst:-false}, 00:26:46.972 "ddgst": ${ddgst:-false} 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 } 00:26:46.972 EOF 00:26:46.972 )") 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.972 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.972 { 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme$subsystem", 00:26:46.972 "trtype": "$TEST_TRANSPORT", 00:26:46.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "$NVMF_PORT", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.972 "hdgst": ${hdgst:-false}, 00:26:46.972 "ddgst": ${ddgst:-false} 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 } 00:26:46.972 EOF 00:26:46.972 )") 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.972 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.972 { 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme$subsystem", 00:26:46.972 "trtype": "$TEST_TRANSPORT", 00:26:46.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "$NVMF_PORT", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.972 "hdgst": ${hdgst:-false}, 00:26:46.972 "ddgst": ${ddgst:-false} 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 } 00:26:46.972 EOF 00:26:46.972 )") 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.972 15:27:50 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:46.972 { 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme$subsystem", 00:26:46.972 "trtype": "$TEST_TRANSPORT", 00:26:46.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "$NVMF_PORT", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:46.972 "hdgst": ${hdgst:-false}, 00:26:46.972 "ddgst": ${ddgst:-false} 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 } 00:26:46.972 EOF 00:26:46.972 )") 00:26:46.972 15:27:50 -- nvmf/common.sh@543 -- # cat 00:26:46.972 15:27:50 -- nvmf/common.sh@545 -- # jq . 00:26:46.972 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.972 15:27:50 -- nvmf/common.sh@546 -- # IFS=, 00:26:46.972 15:27:50 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme1", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme2", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme3", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme4", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme5", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme6", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme7", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme8", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme9", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 },{ 00:26:46.972 "params": { 00:26:46.972 "name": "Nvme10", 00:26:46.972 "trtype": "rdma", 00:26:46.972 "traddr": "192.168.100.8", 00:26:46.972 "adrfam": "ipv4", 00:26:46.972 "trsvcid": "4420", 00:26:46.972 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:46.972 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:46.972 "hdgst": false, 00:26:46.972 "ddgst": false 00:26:46.972 }, 00:26:46.972 "method": "bdev_nvme_attach_controller" 00:26:46.972 }' 00:26:46.972 [2024-04-24 15:27:50.815870] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:47.232 [2024-04-24 15:27:50.893387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:48.169 Running I/O for 10 seconds... 00:26:48.169 15:27:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:48.169 15:27:51 -- common/autotest_common.sh@850 -- # return 0 00:26:48.169 15:27:51 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:48.169 15:27:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:48.169 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.169 15:27:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:48.169 15:27:51 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:48.169 15:27:51 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:26:48.169 15:27:51 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:26:48.169 15:27:51 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:26:48.169 15:27:51 -- target/shutdown.sh@57 -- # local ret=1 00:26:48.169 15:27:51 -- target/shutdown.sh@58 -- # local i 00:26:48.169 15:27:51 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:26:48.169 15:27:51 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:48.169 15:27:51 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:48.169 15:27:51 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:48.169 15:27:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:48.169 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:26:48.429 15:27:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:48.429 15:27:52 -- target/shutdown.sh@60 -- # read_io_count=3 00:26:48.429 15:27:52 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:26:48.429 15:27:52 -- target/shutdown.sh@67 -- # sleep 0.25 00:26:48.688 15:27:52 -- target/shutdown.sh@59 -- # (( i-- )) 00:26:48.688 15:27:52 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:26:48.688 15:27:52 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:26:48.688 15:27:52 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:26:48.688 15:27:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:48.688 15:27:52 -- common/autotest_common.sh@10 -- # set +x 00:26:48.688 15:27:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:48.688 15:27:52 -- target/shutdown.sh@60 -- # read_io_count=195 00:26:48.688 15:27:52 -- target/shutdown.sh@63 -- # '[' 195 -ge 100 ']' 00:26:48.688 15:27:52 -- target/shutdown.sh@64 -- # ret=0 00:26:48.688 15:27:52 -- target/shutdown.sh@65 -- # break 00:26:48.688 15:27:52 -- target/shutdown.sh@69 -- # return 0 00:26:48.688 15:27:52 -- target/shutdown.sh@135 -- # killprocess 738999 00:26:48.688 15:27:52 -- common/autotest_common.sh@936 -- # '[' -z 738999 ']' 00:26:48.688 15:27:52 -- common/autotest_common.sh@940 -- # kill -0 738999 00:26:48.688 15:27:52 -- common/autotest_common.sh@941 -- # uname 00:26:48.688 15:27:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:48.688 15:27:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738999 00:26:48.688 15:27:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:48.688 15:27:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:48.688 15:27:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738999' 00:26:48.688 killing process with pid 738999 00:26:48.688 15:27:52 -- common/autotest_common.sh@955 -- # kill 738999 00:26:48.688 15:27:52 -- common/autotest_common.sh@960 -- # wait 738999 00:26:48.952 [2024-04-24 15:27:52.603077] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:49.213 15:27:52 -- target/shutdown.sh@136 -- # nvmfpid= 00:26:49.213 15:27:53 -- target/shutdown.sh@139 -- # sleep 1 00:26:49.476 [2024-04-24 15:27:53.139589] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.476 [2024-04-24 15:27:53.140033] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:26:49.476 [2024-04-24 15:27:53.140060] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.476 [2024-04-24 15:27:53.140269] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:26:49.476 [2024-04-24 15:27:53.140284] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.476 [2024-04-24 15:27:53.140498] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:26:49.476 [2024-04-24 15:27:53.140515] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.476 [2024-04-24 15:27:53.140529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x4285cb07 00:26:49.476 [2024-04-24 15:27:53.140805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0xce0cb764 00:26:49.476 [2024-04-24 15:27:53.140825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0xce0cb764 00:26:49.476 [2024-04-24 15:27:53.140845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0xce0cb764 00:26:49.476 [2024-04-24 15:27:53.140865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.476 [2024-04-24 15:27:53.140877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.140987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.140998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0xce0cb764 00:26:49.477 [2024-04-24 15:27:53.141440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0xf0180161 00:26:49.477 [2024-04-24 15:27:53.141615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.477 [2024-04-24 15:27:53.141626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0xf0180161 00:26:49.478 [2024-04-24 15:27:53.141834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.141845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x4285cb07 00:26:49.478 [2024-04-24 15:27:53.141854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2c2fc90 sqhd:6780 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142181] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:26:49.478 [2024-04-24 15:27:53.142227] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.478 [2024-04-24 15:27:53.142239] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98900 sqhd:d440 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142259] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98900 sqhd:d440 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98900 sqhd:d440 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98900 sqhd:d440 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.478 [2024-04-24 15:27:53.142470] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:26:49.478 [2024-04-24 15:27:53.142494] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.478 [2024-04-24 15:27:53.142506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98340 sqhd:9c00 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142525] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98340 sqhd:9c00 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142544] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98340 sqhd:9c00 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142574] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98340 sqhd:9c00 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.478 [2024-04-24 15:27:53.142732] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:26:49.478 [2024-04-24 15:27:53.142745] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.478 [2024-04-24 15:27:53.142756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98620 sqhd:60c0 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142775] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98620 sqhd:60c0 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142794] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98620 sqhd:60c0 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142813] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.142826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98620 sqhd:60c0 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.142962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.478 [2024-04-24 15:27:53.142973] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:26:49.478 [2024-04-24 15:27:53.142987] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.478 [2024-04-24 15:27:53.142998] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98060 sqhd:a540 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143016] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98060 sqhd:a540 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98060 sqhd:a540 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2b98060 sqhd:a540 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.478 [2024-04-24 15:27:53.143207] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:26:49.478 [2024-04-24 15:27:53.143222] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.478 [2024-04-24 15:27:53.143232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12ee5f0 sqhd:5380 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143250] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12ee5f0 sqhd:5380 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.478 [2024-04-24 15:27:53.143278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12ee5f0 sqhd:5380 p:0 m:0 dnr:0 00:26:49.478 [2024-04-24 15:27:53.143287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12ee5f0 sqhd:5380 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.143439] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:26:49.479 [2024-04-24 15:27:53.143452] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.143466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12f16f0 sqhd:d080 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12f16f0 sqhd:d080 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12f16f0 sqhd:d080 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:12f16f0 sqhd:d080 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.143685] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:49.479 [2024-04-24 15:27:53.143699] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.143709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1b707b0 sqhd:54c0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1b707b0 sqhd:54c0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143747] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1b707b0 sqhd:54c0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1b707b0 sqhd:54c0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.143923] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:26:49.479 [2024-04-24 15:27:53.143932] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.143945] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.143955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2c2fa30 sqhd:8cc0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143976] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.143985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2c2fa30 sqhd:8cc0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.143994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2c2fa30 sqhd:8cc0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144014] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:2c2fa30 sqhd:8cc0 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.144168] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:26:49.479 [2024-04-24 15:27:53.144176] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.144188] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.144199] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1a909f0 sqhd:f280 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1a909f0 sqhd:f280 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1a909f0 sqhd:f280 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144254] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:1a909f0 sqhd:f280 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.144407] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:26:49.479 [2024-04-24 15:27:53.144416] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.144428] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.144438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:132b610 sqhd:c140 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:132b610 sqhd:c140 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:132b610 sqhd:c140 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:49.479 [2024-04-24 15:27:53.144511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:132b610 sqhd:c140 p:0 m:0 dnr:0 00:26:49.479 [2024-04-24 15:27:53.144648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:49.479 [2024-04-24 15:27:53.144659] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:26:49.479 [2024-04-24 15:27:53.144668] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.144689] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.144891] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.144902] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.144913] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.145110] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.145121] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.145131] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.145325] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.145336] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.145346] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.145564] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.145576] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.145587] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.145783] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.145795] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.479 [2024-04-24 15:27:53.145805] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:26:49.479 [2024-04-24 15:27:53.159834] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:26:49.479 [2024-04-24 15:27:53.159857] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160753] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160771] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160807] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160820] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160832] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160846] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160857] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160870] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160883] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160894] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:49.480 [2024-04-24 15:27:53.160944] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160956] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160967] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160976] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160986] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:26:49.480 [2024-04-24 15:27:53.160996] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:26:49.480 [2024-04-24 15:27:53.161005] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:26:49.480 [2024-04-24 15:27:53.161318] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:26:49.480 [2024-04-24 15:27:53.175290] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175348] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175376] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:26:49.480 [2024-04-24 15:27:53.175427] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175459] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175484] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:26:49.480 [2024-04-24 15:27:53.175630] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175664] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175688] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:26:49.480 [2024-04-24 15:27:53.175732] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175745] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175753] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:26:49.480 [2024-04-24 15:27:53.175770] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175779] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175786] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:26:49.480 [2024-04-24 15:27:53.175803] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175813] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175820] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:26:49.480 [2024-04-24 15:27:53.175836] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175846] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175854] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:49.480 [2024-04-24 15:27:53.175870] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175880] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175887] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:26:49.480 [2024-04-24 15:27:53.175903] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.175913] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.175921] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:26:49.480 [2024-04-24 15:27:53.176122] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:26:49.480 [2024-04-24 15:27:53.176133] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:26:49.480 [2024-04-24 15:27:53.176141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:26:50.049 task offset: 24576 on job bdev=Nvme10n1 fails 00:26:50.049 00:26:50.049 Latency(us) 00:26:50.049 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:50.049 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme1n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme1n1 : 1.92 133.36 8.33 33.34 0.00 377458.87 64282.27 1006632.96 00:26:50.049 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme2n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme2n1 : 1.92 133.32 8.33 33.33 0.00 374406.81 56303.97 1006632.96 00:26:50.049 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme3n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme3n1 : 1.92 166.59 10.41 33.32 0.00 309287.92 7294.44 1006632.96 00:26:50.049 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme4n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme4n1 : 1.92 166.54 10.41 33.31 0.00 306617.21 23251.03 1006632.96 00:26:50.049 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme5n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme5n1 : 1.92 155.04 9.69 33.30 0.00 322433.34 36244.26 1006632.96 00:26:50.049 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme6n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme6n1 : 1.92 138.87 8.68 33.29 0.00 349529.24 45590.26 1006632.96 00:26:50.049 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme7n1 ended in about 1.92 seconds with error 00:26:50.049 Verification LBA range: start 0x0 length 0x400 00:26:50.049 Nvme7n1 : 1.92 148.71 9.29 33.28 0.00 327583.61 49921.34 1006632.96 00:26:50.049 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.049 Job: Nvme8n1 ended in about 1.92 seconds with error 00:26:50.050 Verification LBA range: start 0x0 length 0x400 00:26:50.050 Nvme8n1 : 1.92 148.14 9.26 33.27 0.00 325510.22 57671.68 1006632.96 00:26:50.050 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.050 Job: Nvme9n1 ended in about 1.92 seconds with error 00:26:50.050 Verification LBA range: start 0x0 length 0x400 00:26:50.050 Nvme9n1 : 1.92 133.02 8.31 33.26 0.00 351793.33 58127.58 1006632.96 00:26:50.050 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:50.050 Job: Nvme10n1 ended in about 1.41 seconds with error 00:26:50.050 Verification LBA range: start 0x0 length 0x400 00:26:50.050 Nvme10n1 : 1.41 136.47 8.53 45.49 0.00 312888.10 64282.27 594497.00 00:26:50.050 =================================================================================================================== 00:26:50.050 Total : 1460.06 91.25 345.17 0.00 334848.99 7294.44 1006632.96 00:26:50.050 [2024-04-24 15:27:53.700427] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:26:50.310 15:27:54 -- target/shutdown.sh@142 -- # kill -9 739222 00:26:50.310 15:27:54 -- target/shutdown.sh@144 -- # stoptarget 00:26:50.310 15:27:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:50.310 15:27:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:50.310 15:27:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:50.310 15:27:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:50.310 15:27:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:50.310 15:27:54 -- nvmf/common.sh@117 -- # sync 00:26:50.310 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh: line 116: 739222 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:26:50.310 15:27:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:50.310 15:27:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:50.310 15:27:54 -- nvmf/common.sh@120 -- # set +e 00:26:50.310 15:27:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:50.310 15:27:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:50.310 rmmod nvme_rdma 00:26:50.310 rmmod nvme_fabrics 00:26:50.310 15:27:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:50.310 15:27:54 -- nvmf/common.sh@124 -- # set -e 00:26:50.310 15:27:54 -- nvmf/common.sh@125 -- # return 0 00:26:50.310 15:27:54 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:26:50.310 15:27:54 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:50.310 15:27:54 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:50.310 00:26:50.310 real 0m5.145s 00:26:50.310 user 0m17.431s 00:26:50.310 sys 0m1.469s 00:26:50.310 15:27:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:50.310 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.310 ************************************ 00:26:50.310 END TEST nvmf_shutdown_tc3 00:26:50.310 ************************************ 00:26:50.310 15:27:54 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:26:50.310 00:26:50.310 real 0m24.876s 00:26:50.310 user 1m11.210s 00:26:50.310 sys 0m9.739s 00:26:50.310 15:27:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:50.310 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.310 ************************************ 00:26:50.310 END TEST nvmf_shutdown 00:26:50.310 ************************************ 00:26:50.310 15:27:54 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:26:50.310 15:27:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:50.310 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.310 15:27:54 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:26:50.310 15:27:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:50.310 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.310 15:27:54 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:26:50.310 15:27:54 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:26:50.310 15:27:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:50.310 15:27:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:50.310 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.569 ************************************ 00:26:50.569 START TEST nvmf_multicontroller 00:26:50.569 ************************************ 00:26:50.569 15:27:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:26:50.569 * Looking for test storage... 00:26:50.829 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:26:50.829 15:27:54 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:26:50.829 15:27:54 -- nvmf/common.sh@7 -- # uname -s 00:26:50.829 15:27:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:50.829 15:27:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:50.829 15:27:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:50.829 15:27:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:50.829 15:27:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:50.829 15:27:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:50.829 15:27:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:50.829 15:27:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:50.829 15:27:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:50.829 15:27:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:50.829 15:27:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:26:50.829 15:27:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:26:50.829 15:27:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:50.829 15:27:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:50.829 15:27:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:50.829 15:27:54 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:50.829 15:27:54 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:26:50.829 15:27:54 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:50.829 15:27:54 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:50.829 15:27:54 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:50.829 15:27:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.829 15:27:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.829 15:27:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.829 15:27:54 -- paths/export.sh@5 -- # export PATH 00:26:50.829 15:27:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:50.829 15:27:54 -- nvmf/common.sh@47 -- # : 0 00:26:50.829 15:27:54 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:50.829 15:27:54 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:50.829 15:27:54 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:50.829 15:27:54 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:50.829 15:27:54 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:50.829 15:27:54 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:50.829 15:27:54 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:50.829 15:27:54 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:50.829 15:27:54 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:50.829 15:27:54 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:50.829 15:27:54 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:26:50.829 15:27:54 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:26:50.829 15:27:54 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:26:50.829 15:27:54 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:26:50.829 15:27:54 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:26:50.829 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:26:50.829 15:27:54 -- host/multicontroller.sh@20 -- # exit 0 00:26:50.829 00:26:50.829 real 0m0.143s 00:26:50.829 user 0m0.059s 00:26:50.829 sys 0m0.095s 00:26:50.829 15:27:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:50.829 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.830 ************************************ 00:26:50.830 END TEST nvmf_multicontroller 00:26:50.830 ************************************ 00:26:50.830 15:27:54 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:26:50.830 15:27:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:50.830 15:27:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:50.830 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:50.830 ************************************ 00:26:50.830 START TEST nvmf_aer 00:26:50.830 ************************************ 00:26:50.830 15:27:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:26:51.090 * Looking for test storage... 00:26:51.090 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:26:51.090 15:27:54 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:26:51.090 15:27:54 -- nvmf/common.sh@7 -- # uname -s 00:26:51.090 15:27:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:51.090 15:27:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:51.090 15:27:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:51.090 15:27:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:51.090 15:27:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:51.090 15:27:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:51.090 15:27:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:51.090 15:27:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:51.090 15:27:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:51.090 15:27:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:51.090 15:27:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:26:51.090 15:27:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:26:51.090 15:27:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:51.090 15:27:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:51.090 15:27:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:51.090 15:27:54 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:51.090 15:27:54 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:26:51.090 15:27:54 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:51.090 15:27:54 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:51.090 15:27:54 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:51.090 15:27:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:51.090 15:27:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:51.090 15:27:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:51.090 15:27:54 -- paths/export.sh@5 -- # export PATH 00:26:51.090 15:27:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:51.090 15:27:54 -- nvmf/common.sh@47 -- # : 0 00:26:51.090 15:27:54 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:51.090 15:27:54 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:51.090 15:27:54 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:51.090 15:27:54 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:51.090 15:27:54 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:51.090 15:27:54 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:51.090 15:27:54 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:51.090 15:27:54 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:51.090 15:27:54 -- host/aer.sh@11 -- # nvmftestinit 00:26:51.090 15:27:54 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:51.090 15:27:54 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:51.090 15:27:54 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:51.090 15:27:54 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:51.090 15:27:54 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:51.090 15:27:54 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:51.090 15:27:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:51.090 15:27:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:51.090 15:27:54 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:51.090 15:27:54 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:51.090 15:27:54 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:51.090 15:27:54 -- common/autotest_common.sh@10 -- # set +x 00:26:59.213 15:28:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:59.213 15:28:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:59.213 15:28:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:59.213 15:28:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:59.213 15:28:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:59.213 15:28:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:59.213 15:28:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:59.213 15:28:01 -- nvmf/common.sh@295 -- # net_devs=() 00:26:59.213 15:28:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:59.213 15:28:01 -- nvmf/common.sh@296 -- # e810=() 00:26:59.213 15:28:01 -- nvmf/common.sh@296 -- # local -ga e810 00:26:59.213 15:28:01 -- nvmf/common.sh@297 -- # x722=() 00:26:59.213 15:28:01 -- nvmf/common.sh@297 -- # local -ga x722 00:26:59.213 15:28:01 -- nvmf/common.sh@298 -- # mlx=() 00:26:59.213 15:28:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:59.213 15:28:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:59.213 15:28:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:59.213 15:28:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:59.213 15:28:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:59.213 15:28:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:59.213 15:28:01 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:26:59.213 15:28:01 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:26:59.213 15:28:01 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:26:59.213 15:28:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:59.213 15:28:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:59.213 15:28:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:26:59.213 Found 0000:18:00.0 (0x8086 - 0x1592) 00:26:59.213 15:28:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:59.213 15:28:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:59.214 15:28:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:26:59.214 Found 0000:18:00.1 (0x8086 - 0x1592) 00:26:59.214 15:28:01 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:59.214 15:28:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@377 -- # modinfo irdma 00:26:59.214 15:28:01 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:26:59.214 15:28:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:59.214 15:28:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:59.214 15:28:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:26:59.214 Found net devices under 0000:18:00.0: cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:59.214 15:28:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:59.214 15:28:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:59.214 15:28:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:26:59.214 Found net devices under 0000:18:00.1: cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:59.214 15:28:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:59.214 15:28:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:59.214 15:28:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:59.214 15:28:01 -- nvmf/common.sh@58 -- # uname 00:26:59.214 15:28:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:59.214 15:28:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:59.214 15:28:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:59.214 15:28:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:59.214 15:28:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:59.214 15:28:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:59.214 15:28:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:59.214 15:28:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:59.214 15:28:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:59.214 15:28:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:59.214 15:28:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:59.214 15:28:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:59.214 15:28:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:59.214 15:28:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:59.214 15:28:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:59.214 15:28:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@105 -- # continue 2 00:26:59.214 15:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@105 -- # continue 2 00:26:59.214 15:28:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:59.214 15:28:01 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:59.214 15:28:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:59.214 15:28:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:26:59.214 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:59.214 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:26:59.214 altname enp24s0f0np0 00:26:59.214 altname ens785f0np0 00:26:59.214 inet 192.168.100.8/24 scope global cvl_0_0 00:26:59.214 valid_lft forever preferred_lft forever 00:26:59.214 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:26:59.214 valid_lft forever preferred_lft forever 00:26:59.214 15:28:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:59.214 15:28:01 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:59.214 15:28:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:59.214 15:28:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:26:59.214 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:26:59.214 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:26:59.214 altname enp24s0f1np1 00:26:59.214 altname ens785f1np1 00:26:59.214 inet 192.168.100.9/24 scope global cvl_0_1 00:26:59.214 valid_lft forever preferred_lft forever 00:26:59.214 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:26:59.214 valid_lft forever preferred_lft forever 00:26:59.214 15:28:01 -- nvmf/common.sh@411 -- # return 0 00:26:59.214 15:28:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:59.214 15:28:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:59.214 15:28:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:59.214 15:28:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:59.214 15:28:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:59.214 15:28:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:59.214 15:28:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:59.214 15:28:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:59.214 15:28:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:59.214 15:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@105 -- # continue 2 00:26:59.214 15:28:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:59.214 15:28:01 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:26:59.214 15:28:01 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@105 -- # continue 2 00:26:59.214 15:28:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:59.214 15:28:01 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:59.214 15:28:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:59.214 15:28:01 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:59.214 15:28:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:59.214 15:28:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:59.214 192.168.100.9' 00:26:59.214 15:28:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:59.214 192.168.100.9' 00:26:59.214 15:28:01 -- nvmf/common.sh@446 -- # head -n 1 00:26:59.214 15:28:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:59.214 15:28:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:59.214 192.168.100.9' 00:26:59.214 15:28:01 -- nvmf/common.sh@447 -- # tail -n +2 00:26:59.214 15:28:01 -- nvmf/common.sh@447 -- # head -n 1 00:26:59.214 15:28:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:59.214 15:28:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:59.214 15:28:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:59.214 15:28:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:59.214 15:28:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:59.214 15:28:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:59.214 15:28:02 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:26:59.214 15:28:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:59.214 15:28:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:59.214 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.214 15:28:02 -- nvmf/common.sh@470 -- # nvmfpid=743111 00:26:59.214 15:28:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:59.214 15:28:02 -- nvmf/common.sh@471 -- # waitforlisten 743111 00:26:59.215 15:28:02 -- common/autotest_common.sh@817 -- # '[' -z 743111 ']' 00:26:59.215 15:28:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:59.215 15:28:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:59.215 15:28:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:59.215 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:59.215 15:28:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:59.215 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 [2024-04-24 15:28:02.075497] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:26:59.215 [2024-04-24 15:28:02.075554] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:59.215 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.215 [2024-04-24 15:28:02.156386] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:59.215 [2024-04-24 15:28:02.241163] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:59.215 [2024-04-24 15:28:02.241206] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:59.215 [2024-04-24 15:28:02.241217] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:59.215 [2024-04-24 15:28:02.241227] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:59.215 [2024-04-24 15:28:02.241235] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:59.215 [2024-04-24 15:28:02.241293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:59.215 [2024-04-24 15:28:02.241332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:59.215 [2024-04-24 15:28:02.241311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:59.215 [2024-04-24 15:28:02.241333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:59.215 15:28:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:59.215 15:28:02 -- common/autotest_common.sh@850 -- # return 0 00:26:59.215 15:28:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:59.215 15:28:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:59.215 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 15:28:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:59.215 15:28:02 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:59.215 15:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 [2024-04-24 15:28:02.951734] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xdd5910/0xdd4f50) succeed. 00:26:59.215 [2024-04-24 15:28:02.962187] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xdd6c80/0xdd54d0) succeed. 00:26:59.215 [2024-04-24 15:28:02.962211] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:26:59.215 15:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:02 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:26:59.215 15:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 Malloc0 00:26:59.215 15:28:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:02 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:26:59.215 15:28:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:03 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:59.215 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:03 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:26:59.215 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 [2024-04-24 15:28:03.017807] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:59.215 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:03 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:26:59.215 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.215 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.215 [2024-04-24 15:28:03.025707] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:59.215 [ 00:26:59.215 { 00:26:59.215 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:59.215 "subtype": "Discovery", 00:26:59.215 "listen_addresses": [], 00:26:59.215 "allow_any_host": true, 00:26:59.215 "hosts": [] 00:26:59.215 }, 00:26:59.215 { 00:26:59.215 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.215 "subtype": "NVMe", 00:26:59.215 "listen_addresses": [ 00:26:59.215 { 00:26:59.215 "transport": "RDMA", 00:26:59.215 "trtype": "RDMA", 00:26:59.215 "adrfam": "IPv4", 00:26:59.215 "traddr": "192.168.100.8", 00:26:59.215 "trsvcid": "4420" 00:26:59.215 } 00:26:59.215 ], 00:26:59.215 "allow_any_host": true, 00:26:59.215 "hosts": [], 00:26:59.215 "serial_number": "SPDK00000000000001", 00:26:59.215 "model_number": "SPDK bdev Controller", 00:26:59.215 "max_namespaces": 2, 00:26:59.215 "min_cntlid": 1, 00:26:59.215 "max_cntlid": 65519, 00:26:59.215 "namespaces": [ 00:26:59.215 { 00:26:59.215 "nsid": 1, 00:26:59.215 "bdev_name": "Malloc0", 00:26:59.215 "name": "Malloc0", 00:26:59.215 "nguid": "906314862E0C444B993CDF781CB6EDAD", 00:26:59.215 "uuid": "90631486-2e0c-444b-993c-df781cb6edad" 00:26:59.215 } 00:26:59.215 ] 00:26:59.215 } 00:26:59.215 ] 00:26:59.215 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.215 15:28:03 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:26:59.215 15:28:03 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:26:59.215 15:28:03 -- host/aer.sh@33 -- # aerpid=743271 00:26:59.215 15:28:03 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:26:59.215 15:28:03 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:26:59.215 15:28:03 -- common/autotest_common.sh@1251 -- # local i=0 00:26:59.215 15:28:03 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:59.215 15:28:03 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:26:59.215 15:28:03 -- common/autotest_common.sh@1254 -- # i=1 00:26:59.215 15:28:03 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:26:59.215 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.475 15:28:03 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:59.475 15:28:03 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:26:59.475 15:28:03 -- common/autotest_common.sh@1254 -- # i=2 00:26:59.475 15:28:03 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:26:59.475 15:28:03 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:59.475 15:28:03 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:26:59.475 15:28:03 -- common/autotest_common.sh@1262 -- # return 0 00:26:59.475 15:28:03 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:26:59.475 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.475 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.475 Malloc1 00:26:59.475 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.475 15:28:03 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:26:59.475 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.475 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.475 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.475 15:28:03 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:26:59.475 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.475 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.475 [ 00:26:59.475 { 00:26:59.475 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:59.475 "subtype": "Discovery", 00:26:59.475 "listen_addresses": [], 00:26:59.475 "allow_any_host": true, 00:26:59.475 "hosts": [] 00:26:59.475 }, 00:26:59.475 { 00:26:59.475 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.475 "subtype": "NVMe", 00:26:59.475 "listen_addresses": [ 00:26:59.475 { 00:26:59.475 "transport": "RDMA", 00:26:59.475 "trtype": "RDMA", 00:26:59.475 "adrfam": "IPv4", 00:26:59.475 "traddr": "192.168.100.8", 00:26:59.475 "trsvcid": "4420" 00:26:59.475 } 00:26:59.475 ], 00:26:59.475 "allow_any_host": true, 00:26:59.475 "hosts": [], 00:26:59.475 "serial_number": "SPDK00000000000001", 00:26:59.475 "model_number": "SPDK bdev Controller", 00:26:59.475 "max_namespaces": 2, 00:26:59.475 "min_cntlid": 1, 00:26:59.475 "max_cntlid": 65519, 00:26:59.475 "namespaces": [ 00:26:59.475 { 00:26:59.475 "nsid": 1, 00:26:59.475 "bdev_name": "Malloc0", 00:26:59.475 "name": "Malloc0", 00:26:59.475 "nguid": "906314862E0C444B993CDF781CB6EDAD", 00:26:59.475 "uuid": "90631486-2e0c-444b-993c-df781cb6edad" 00:26:59.475 }, 00:26:59.475 { 00:26:59.475 "nsid": 2, 00:26:59.475 "bdev_name": "Malloc1", 00:26:59.475 "name": "Malloc1", 00:26:59.475 "nguid": "32057BBAB05C493FA38E6E91B2D72624", 00:26:59.475 "uuid": "32057bba-b05c-493f-a38e-6e91b2d72624" 00:26:59.475 } 00:26:59.475 ] 00:26:59.475 } 00:26:59.475 ] 00:26:59.475 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.475 15:28:03 -- host/aer.sh@43 -- # wait 743271 00:26:59.475 Asynchronous Event Request test 00:26:59.475 Attaching to 192.168.100.8 00:26:59.475 Attached to 192.168.100.8 00:26:59.475 Registering asynchronous event callbacks... 00:26:59.475 Starting namespace attribute notice tests for all controllers... 00:26:59.475 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:26:59.475 aer_cb - Changed Namespace 00:26:59.475 Cleaning up... 00:26:59.475 15:28:03 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:26:59.475 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.475 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.735 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.735 15:28:03 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:26:59.735 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.735 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.735 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.735 15:28:03 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:59.735 15:28:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:59.735 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.735 15:28:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.735 15:28:03 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:26:59.735 15:28:03 -- host/aer.sh@51 -- # nvmftestfini 00:26:59.735 15:28:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:59.735 15:28:03 -- nvmf/common.sh@117 -- # sync 00:26:59.735 15:28:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:59.735 15:28:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:59.735 15:28:03 -- nvmf/common.sh@120 -- # set +e 00:26:59.735 15:28:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:59.735 15:28:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:59.735 rmmod nvme_rdma 00:26:59.735 rmmod nvme_fabrics 00:26:59.735 15:28:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:59.735 15:28:03 -- nvmf/common.sh@124 -- # set -e 00:26:59.735 15:28:03 -- nvmf/common.sh@125 -- # return 0 00:26:59.735 15:28:03 -- nvmf/common.sh@478 -- # '[' -n 743111 ']' 00:26:59.735 15:28:03 -- nvmf/common.sh@479 -- # killprocess 743111 00:26:59.735 15:28:03 -- common/autotest_common.sh@936 -- # '[' -z 743111 ']' 00:26:59.735 15:28:03 -- common/autotest_common.sh@940 -- # kill -0 743111 00:26:59.735 15:28:03 -- common/autotest_common.sh@941 -- # uname 00:26:59.735 15:28:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:59.735 15:28:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 743111 00:26:59.735 15:28:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:59.735 15:28:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:59.735 15:28:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 743111' 00:26:59.735 killing process with pid 743111 00:26:59.735 15:28:03 -- common/autotest_common.sh@955 -- # kill 743111 00:26:59.735 [2024-04-24 15:28:03.533040] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:59.735 15:28:03 -- common/autotest_common.sh@960 -- # wait 743111 00:26:59.735 [2024-04-24 15:28:03.566361] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:59.994 15:28:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:59.994 15:28:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:59.994 00:26:59.994 real 0m9.094s 00:26:59.994 user 0m8.266s 00:26:59.994 sys 0m5.922s 00:26:59.994 15:28:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:59.994 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:26:59.994 ************************************ 00:26:59.994 END TEST nvmf_aer 00:26:59.994 ************************************ 00:26:59.994 15:28:03 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:26:59.994 15:28:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:59.994 15:28:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:59.994 15:28:03 -- common/autotest_common.sh@10 -- # set +x 00:27:00.254 ************************************ 00:27:00.254 START TEST nvmf_async_init 00:27:00.254 ************************************ 00:27:00.254 15:28:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:27:00.254 * Looking for test storage... 00:27:00.254 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:00.254 15:28:04 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:00.254 15:28:04 -- nvmf/common.sh@7 -- # uname -s 00:27:00.254 15:28:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:00.254 15:28:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:00.254 15:28:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:00.254 15:28:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:00.254 15:28:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:00.254 15:28:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:00.254 15:28:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:00.254 15:28:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:00.254 15:28:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:00.254 15:28:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:00.254 15:28:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:27:00.254 15:28:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:27:00.254 15:28:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:00.254 15:28:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:00.254 15:28:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:00.254 15:28:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:00.254 15:28:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:00.254 15:28:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:00.254 15:28:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:00.254 15:28:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:00.254 15:28:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.254 15:28:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.254 15:28:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.254 15:28:04 -- paths/export.sh@5 -- # export PATH 00:27:00.254 15:28:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:00.254 15:28:04 -- nvmf/common.sh@47 -- # : 0 00:27:00.254 15:28:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:00.254 15:28:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:00.254 15:28:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:00.254 15:28:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:00.254 15:28:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:00.254 15:28:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:00.254 15:28:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:00.254 15:28:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:00.254 15:28:04 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:27:00.254 15:28:04 -- host/async_init.sh@14 -- # null_block_size=512 00:27:00.255 15:28:04 -- host/async_init.sh@15 -- # null_bdev=null0 00:27:00.255 15:28:04 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:27:00.255 15:28:04 -- host/async_init.sh@20 -- # uuidgen 00:27:00.255 15:28:04 -- host/async_init.sh@20 -- # tr -d - 00:27:00.255 15:28:04 -- host/async_init.sh@20 -- # nguid=9f0915723f874a5bac63eb16fe961504 00:27:00.255 15:28:04 -- host/async_init.sh@22 -- # nvmftestinit 00:27:00.255 15:28:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:00.255 15:28:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:00.255 15:28:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:00.255 15:28:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:00.255 15:28:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:00.255 15:28:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:00.255 15:28:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:00.255 15:28:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:00.255 15:28:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:00.255 15:28:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:00.255 15:28:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:00.255 15:28:04 -- common/autotest_common.sh@10 -- # set +x 00:27:08.391 15:28:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:08.391 15:28:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:08.391 15:28:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:08.391 15:28:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:08.391 15:28:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:08.391 15:28:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:08.391 15:28:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:08.391 15:28:11 -- nvmf/common.sh@295 -- # net_devs=() 00:27:08.391 15:28:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:08.391 15:28:11 -- nvmf/common.sh@296 -- # e810=() 00:27:08.391 15:28:11 -- nvmf/common.sh@296 -- # local -ga e810 00:27:08.391 15:28:11 -- nvmf/common.sh@297 -- # x722=() 00:27:08.391 15:28:11 -- nvmf/common.sh@297 -- # local -ga x722 00:27:08.391 15:28:11 -- nvmf/common.sh@298 -- # mlx=() 00:27:08.391 15:28:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:08.391 15:28:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:08.391 15:28:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:08.392 15:28:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:08.392 15:28:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:08.392 15:28:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:27:08.392 Found 0000:18:00.0 (0x8086 - 0x1592) 00:27:08.392 15:28:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:08.392 15:28:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:27:08.392 Found 0000:18:00.1 (0x8086 - 0x1592) 00:27:08.392 15:28:11 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:08.392 15:28:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@377 -- # modinfo irdma 00:27:08.392 15:28:11 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:27:08.392 15:28:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:08.392 15:28:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:08.392 15:28:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:27:08.392 Found net devices under 0000:18:00.0: cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:08.392 15:28:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:08.392 15:28:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:27:08.392 Found net devices under 0000:18:00.1: cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:08.392 15:28:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:08.392 15:28:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:08.392 15:28:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:08.392 15:28:11 -- nvmf/common.sh@58 -- # uname 00:27:08.392 15:28:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:08.392 15:28:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:08.392 15:28:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:08.392 15:28:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:08.392 15:28:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:08.392 15:28:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:08.392 15:28:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:08.392 15:28:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:08.392 15:28:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:08.392 15:28:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:08.392 15:28:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:08.392 15:28:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:08.392 15:28:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:08.392 15:28:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:08.392 15:28:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:08.392 15:28:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@105 -- # continue 2 00:27:08.392 15:28:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@105 -- # continue 2 00:27:08.392 15:28:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:08.392 15:28:11 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:08.392 15:28:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:08.392 15:28:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:27:08.392 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:08.392 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:27:08.392 altname enp24s0f0np0 00:27:08.392 altname ens785f0np0 00:27:08.392 inet 192.168.100.8/24 scope global cvl_0_0 00:27:08.392 valid_lft forever preferred_lft forever 00:27:08.392 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:27:08.392 valid_lft forever preferred_lft forever 00:27:08.392 15:28:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:08.392 15:28:11 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:08.392 15:28:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:08.392 15:28:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:27:08.392 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:08.392 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:27:08.392 altname enp24s0f1np1 00:27:08.392 altname ens785f1np1 00:27:08.392 inet 192.168.100.9/24 scope global cvl_0_1 00:27:08.392 valid_lft forever preferred_lft forever 00:27:08.392 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:27:08.392 valid_lft forever preferred_lft forever 00:27:08.392 15:28:11 -- nvmf/common.sh@411 -- # return 0 00:27:08.392 15:28:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:08.392 15:28:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:08.392 15:28:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:08.392 15:28:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:08.392 15:28:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:08.392 15:28:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:08.392 15:28:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:08.392 15:28:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:08.392 15:28:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:08.392 15:28:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@105 -- # continue 2 00:27:08.392 15:28:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:08.392 15:28:11 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:08.392 15:28:11 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@105 -- # continue 2 00:27:08.392 15:28:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:08.392 15:28:11 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:08.392 15:28:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:08.392 15:28:11 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:08.392 15:28:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:08.392 15:28:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:08.392 192.168.100.9' 00:27:08.392 15:28:11 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:08.392 192.168.100.9' 00:27:08.392 15:28:11 -- nvmf/common.sh@446 -- # head -n 1 00:27:08.392 15:28:11 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:08.392 15:28:11 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:08.392 192.168.100.9' 00:27:08.392 15:28:11 -- nvmf/common.sh@447 -- # tail -n +2 00:27:08.392 15:28:11 -- nvmf/common.sh@447 -- # head -n 1 00:27:08.393 15:28:11 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:08.393 15:28:11 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:08.393 15:28:11 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:08.393 15:28:11 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:08.393 15:28:11 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:08.393 15:28:11 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:08.393 15:28:11 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:27:08.393 15:28:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:08.393 15:28:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:08.393 15:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:08.393 15:28:11 -- nvmf/common.sh@470 -- # nvmfpid=746685 00:27:08.393 15:28:11 -- nvmf/common.sh@471 -- # waitforlisten 746685 00:27:08.393 15:28:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:27:08.393 15:28:11 -- common/autotest_common.sh@817 -- # '[' -z 746685 ']' 00:27:08.393 15:28:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:08.393 15:28:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:08.393 15:28:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:08.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:08.393 15:28:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:08.393 15:28:11 -- common/autotest_common.sh@10 -- # set +x 00:27:08.393 [2024-04-24 15:28:11.649867] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:08.393 [2024-04-24 15:28:11.649923] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:08.393 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.393 [2024-04-24 15:28:11.734698] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.393 [2024-04-24 15:28:11.811872] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:08.393 [2024-04-24 15:28:11.811918] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:08.393 [2024-04-24 15:28:11.811927] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:08.393 [2024-04-24 15:28:11.811936] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:08.393 [2024-04-24 15:28:11.811943] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:08.393 [2024-04-24 15:28:11.811973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:08.653 15:28:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:08.653 15:28:12 -- common/autotest_common.sh@850 -- # return 0 00:27:08.653 15:28:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:08.653 15:28:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:08.653 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.653 15:28:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:08.653 15:28:12 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:08.653 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.653 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.653 [2024-04-24 15:28:12.529940] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1355800/0x1354e40) succeed. 00:27:08.653 [2024-04-24 15:28:12.538967] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1356ab0/0x13553c0) succeed. 00:27:08.653 [2024-04-24 15:28:12.538991] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:27:08.653 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.653 15:28:12 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:27:08.653 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.653 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.653 null0 00:27:08.653 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.653 15:28:12 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:27:08.653 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.653 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.653 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.653 15:28:12 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.915 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.915 15:28:12 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 9f0915723f874a5bac63eb16fe961504 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.915 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.915 15:28:12 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.915 [2024-04-24 15:28:12.588530] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:08.915 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.915 15:28:12 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.915 nvme0n1 00:27:08.915 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.915 15:28:12 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.915 [ 00:27:08.915 { 00:27:08.915 "name": "nvme0n1", 00:27:08.915 "aliases": [ 00:27:08.915 "9f091572-3f87-4a5b-ac63-eb16fe961504" 00:27:08.915 ], 00:27:08.915 "product_name": "NVMe disk", 00:27:08.915 "block_size": 512, 00:27:08.915 "num_blocks": 2097152, 00:27:08.915 "uuid": "9f091572-3f87-4a5b-ac63-eb16fe961504", 00:27:08.915 "assigned_rate_limits": { 00:27:08.915 "rw_ios_per_sec": 0, 00:27:08.915 "rw_mbytes_per_sec": 0, 00:27:08.915 "r_mbytes_per_sec": 0, 00:27:08.915 "w_mbytes_per_sec": 0 00:27:08.915 }, 00:27:08.915 "claimed": false, 00:27:08.915 "zoned": false, 00:27:08.915 "supported_io_types": { 00:27:08.915 "read": true, 00:27:08.915 "write": true, 00:27:08.915 "unmap": false, 00:27:08.915 "write_zeroes": true, 00:27:08.915 "flush": true, 00:27:08.915 "reset": true, 00:27:08.915 "compare": true, 00:27:08.915 "compare_and_write": true, 00:27:08.915 "abort": true, 00:27:08.915 "nvme_admin": true, 00:27:08.915 "nvme_io": true 00:27:08.915 }, 00:27:08.915 "memory_domains": [ 00:27:08.915 { 00:27:08.915 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:08.915 "dma_device_type": 0 00:27:08.915 } 00:27:08.915 ], 00:27:08.915 "driver_specific": { 00:27:08.915 "nvme": [ 00:27:08.915 { 00:27:08.915 "trid": { 00:27:08.915 "trtype": "RDMA", 00:27:08.915 "adrfam": "IPv4", 00:27:08.915 "traddr": "192.168.100.8", 00:27:08.915 "trsvcid": "4420", 00:27:08.915 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:08.915 }, 00:27:08.915 "ctrlr_data": { 00:27:08.915 "cntlid": 1, 00:27:08.915 "vendor_id": "0x8086", 00:27:08.915 "model_number": "SPDK bdev Controller", 00:27:08.915 "serial_number": "00000000000000000000", 00:27:08.915 "firmware_revision": "24.05", 00:27:08.915 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:08.915 "oacs": { 00:27:08.915 "security": 0, 00:27:08.915 "format": 0, 00:27:08.915 "firmware": 0, 00:27:08.915 "ns_manage": 0 00:27:08.915 }, 00:27:08.915 "multi_ctrlr": true, 00:27:08.915 "ana_reporting": false 00:27:08.915 }, 00:27:08.915 "vs": { 00:27:08.915 "nvme_version": "1.3" 00:27:08.915 }, 00:27:08.915 "ns_data": { 00:27:08.915 "id": 1, 00:27:08.915 "can_share": true 00:27:08.915 } 00:27:08.915 } 00:27:08.915 ], 00:27:08.915 "mp_policy": "active_passive" 00:27:08.915 } 00:27:08.915 } 00:27:08.915 ] 00:27:08.915 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.915 15:28:12 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:27:08.915 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.915 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.916 [2024-04-24 15:28:12.700822] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:08.916 [2024-04-24 15:28:12.717901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:08.916 [2024-04-24 15:28:12.740373] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:08.916 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.916 15:28:12 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:08.916 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.916 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.916 [ 00:27:08.916 { 00:27:08.916 "name": "nvme0n1", 00:27:08.916 "aliases": [ 00:27:08.916 "9f091572-3f87-4a5b-ac63-eb16fe961504" 00:27:08.916 ], 00:27:08.916 "product_name": "NVMe disk", 00:27:08.916 "block_size": 512, 00:27:08.916 "num_blocks": 2097152, 00:27:08.916 "uuid": "9f091572-3f87-4a5b-ac63-eb16fe961504", 00:27:08.916 "assigned_rate_limits": { 00:27:08.916 "rw_ios_per_sec": 0, 00:27:08.916 "rw_mbytes_per_sec": 0, 00:27:08.916 "r_mbytes_per_sec": 0, 00:27:08.916 "w_mbytes_per_sec": 0 00:27:08.916 }, 00:27:08.916 "claimed": false, 00:27:08.916 "zoned": false, 00:27:08.916 "supported_io_types": { 00:27:08.916 "read": true, 00:27:08.916 "write": true, 00:27:08.916 "unmap": false, 00:27:08.916 "write_zeroes": true, 00:27:08.916 "flush": true, 00:27:08.916 "reset": true, 00:27:08.916 "compare": true, 00:27:08.916 "compare_and_write": true, 00:27:08.916 "abort": true, 00:27:08.916 "nvme_admin": true, 00:27:08.916 "nvme_io": true 00:27:08.916 }, 00:27:08.916 "memory_domains": [ 00:27:08.916 { 00:27:08.916 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:08.916 "dma_device_type": 0 00:27:08.916 } 00:27:08.916 ], 00:27:08.916 "driver_specific": { 00:27:08.916 "nvme": [ 00:27:08.916 { 00:27:08.916 "trid": { 00:27:08.916 "trtype": "RDMA", 00:27:08.916 "adrfam": "IPv4", 00:27:08.916 "traddr": "192.168.100.8", 00:27:08.916 "trsvcid": "4420", 00:27:08.916 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:08.916 }, 00:27:08.916 "ctrlr_data": { 00:27:08.916 "cntlid": 2, 00:27:08.916 "vendor_id": "0x8086", 00:27:08.916 "model_number": "SPDK bdev Controller", 00:27:08.916 "serial_number": "00000000000000000000", 00:27:08.916 "firmware_revision": "24.05", 00:27:08.916 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:08.916 "oacs": { 00:27:08.916 "security": 0, 00:27:08.916 "format": 0, 00:27:08.916 "firmware": 0, 00:27:08.916 "ns_manage": 0 00:27:08.916 }, 00:27:08.916 "multi_ctrlr": true, 00:27:08.916 "ana_reporting": false 00:27:08.916 }, 00:27:08.916 "vs": { 00:27:08.916 "nvme_version": "1.3" 00:27:08.916 }, 00:27:08.916 "ns_data": { 00:27:08.916 "id": 1, 00:27:08.916 "can_share": true 00:27:08.916 } 00:27:08.916 } 00:27:08.916 ], 00:27:08.916 "mp_policy": "active_passive" 00:27:08.916 } 00:27:08.916 } 00:27:08.916 ] 00:27:08.916 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.916 15:28:12 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:08.916 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.916 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.916 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.916 15:28:12 -- host/async_init.sh@53 -- # mktemp 00:27:08.916 15:28:12 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.LjapKpGsXK 00:27:08.916 15:28:12 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:27:08.916 15:28:12 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.LjapKpGsXK 00:27:08.916 15:28:12 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:27:08.916 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.916 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:08.916 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:08.916 15:28:12 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:27:08.916 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:08.916 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:09.177 [2024-04-24 15:28:12.827248] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:27:09.177 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.177 15:28:12 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.LjapKpGsXK 00:27:09.177 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.177 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:09.177 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.177 15:28:12 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.LjapKpGsXK 00:27:09.177 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.177 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:09.177 [2024-04-24 15:28:12.847273] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:27:09.177 nvme0n1 00:27:09.177 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.177 15:28:12 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:09.177 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.177 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:09.177 [ 00:27:09.177 { 00:27:09.177 "name": "nvme0n1", 00:27:09.177 "aliases": [ 00:27:09.177 "9f091572-3f87-4a5b-ac63-eb16fe961504" 00:27:09.177 ], 00:27:09.177 "product_name": "NVMe disk", 00:27:09.177 "block_size": 512, 00:27:09.177 "num_blocks": 2097152, 00:27:09.177 "uuid": "9f091572-3f87-4a5b-ac63-eb16fe961504", 00:27:09.177 "assigned_rate_limits": { 00:27:09.177 "rw_ios_per_sec": 0, 00:27:09.177 "rw_mbytes_per_sec": 0, 00:27:09.177 "r_mbytes_per_sec": 0, 00:27:09.177 "w_mbytes_per_sec": 0 00:27:09.177 }, 00:27:09.177 "claimed": false, 00:27:09.177 "zoned": false, 00:27:09.177 "supported_io_types": { 00:27:09.177 "read": true, 00:27:09.177 "write": true, 00:27:09.177 "unmap": false, 00:27:09.177 "write_zeroes": true, 00:27:09.177 "flush": true, 00:27:09.177 "reset": true, 00:27:09.177 "compare": true, 00:27:09.177 "compare_and_write": true, 00:27:09.177 "abort": true, 00:27:09.177 "nvme_admin": true, 00:27:09.177 "nvme_io": true 00:27:09.177 }, 00:27:09.177 "memory_domains": [ 00:27:09.177 { 00:27:09.177 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:09.177 "dma_device_type": 0 00:27:09.177 } 00:27:09.177 ], 00:27:09.177 "driver_specific": { 00:27:09.177 "nvme": [ 00:27:09.177 { 00:27:09.177 "trid": { 00:27:09.177 "trtype": "RDMA", 00:27:09.177 "adrfam": "IPv4", 00:27:09.177 "traddr": "192.168.100.8", 00:27:09.177 "trsvcid": "4421", 00:27:09.177 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:09.177 }, 00:27:09.177 "ctrlr_data": { 00:27:09.177 "cntlid": 3, 00:27:09.177 "vendor_id": "0x8086", 00:27:09.177 "model_number": "SPDK bdev Controller", 00:27:09.177 "serial_number": "00000000000000000000", 00:27:09.177 "firmware_revision": "24.05", 00:27:09.177 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:09.177 "oacs": { 00:27:09.177 "security": 0, 00:27:09.177 "format": 0, 00:27:09.177 "firmware": 0, 00:27:09.177 "ns_manage": 0 00:27:09.177 }, 00:27:09.177 "multi_ctrlr": true, 00:27:09.177 "ana_reporting": false 00:27:09.177 }, 00:27:09.177 "vs": { 00:27:09.177 "nvme_version": "1.3" 00:27:09.177 }, 00:27:09.177 "ns_data": { 00:27:09.177 "id": 1, 00:27:09.177 "can_share": true 00:27:09.177 } 00:27:09.177 } 00:27:09.177 ], 00:27:09.177 "mp_policy": "active_passive" 00:27:09.177 } 00:27:09.177 } 00:27:09.177 ] 00:27:09.177 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.177 15:28:12 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:09.177 15:28:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:09.177 15:28:12 -- common/autotest_common.sh@10 -- # set +x 00:27:09.177 15:28:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:09.177 15:28:12 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.LjapKpGsXK 00:27:09.177 15:28:12 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:27:09.177 15:28:12 -- host/async_init.sh@78 -- # nvmftestfini 00:27:09.177 15:28:12 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:09.177 15:28:12 -- nvmf/common.sh@117 -- # sync 00:27:09.177 15:28:12 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:09.177 15:28:12 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:09.177 15:28:12 -- nvmf/common.sh@120 -- # set +e 00:27:09.177 15:28:12 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:09.177 15:28:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:09.177 rmmod nvme_rdma 00:27:09.177 rmmod nvme_fabrics 00:27:09.177 15:28:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:09.177 15:28:13 -- nvmf/common.sh@124 -- # set -e 00:27:09.177 15:28:13 -- nvmf/common.sh@125 -- # return 0 00:27:09.177 15:28:13 -- nvmf/common.sh@478 -- # '[' -n 746685 ']' 00:27:09.177 15:28:13 -- nvmf/common.sh@479 -- # killprocess 746685 00:27:09.177 15:28:13 -- common/autotest_common.sh@936 -- # '[' -z 746685 ']' 00:27:09.177 15:28:13 -- common/autotest_common.sh@940 -- # kill -0 746685 00:27:09.177 15:28:13 -- common/autotest_common.sh@941 -- # uname 00:27:09.177 15:28:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:09.177 15:28:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 746685 00:27:09.177 15:28:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:09.177 15:28:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:09.177 15:28:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 746685' 00:27:09.177 killing process with pid 746685 00:27:09.177 15:28:13 -- common/autotest_common.sh@955 -- # kill 746685 00:27:09.177 15:28:13 -- common/autotest_common.sh@960 -- # wait 746685 00:27:09.437 [2024-04-24 15:28:13.096025] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:09.437 15:28:13 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:09.437 15:28:13 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:09.437 00:27:09.437 real 0m9.309s 00:27:09.437 user 0m3.902s 00:27:09.437 sys 0m6.208s 00:27:09.437 15:28:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:09.437 15:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:09.437 ************************************ 00:27:09.437 END TEST nvmf_async_init 00:27:09.437 ************************************ 00:27:09.697 15:28:13 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:09.697 15:28:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:09.697 15:28:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:09.697 15:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:09.697 ************************************ 00:27:09.697 START TEST dma 00:27:09.697 ************************************ 00:27:09.697 15:28:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:09.957 * Looking for test storage... 00:27:09.957 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:09.957 15:28:13 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:09.957 15:28:13 -- nvmf/common.sh@7 -- # uname -s 00:27:09.957 15:28:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:09.957 15:28:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:09.957 15:28:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:09.957 15:28:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:09.957 15:28:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:09.957 15:28:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:09.957 15:28:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:09.957 15:28:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:09.957 15:28:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:09.957 15:28:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:09.957 15:28:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:27:09.957 15:28:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:27:09.957 15:28:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:09.957 15:28:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:09.957 15:28:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:09.957 15:28:13 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:09.957 15:28:13 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:09.957 15:28:13 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:09.957 15:28:13 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:09.957 15:28:13 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:09.957 15:28:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.957 15:28:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.957 15:28:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.957 15:28:13 -- paths/export.sh@5 -- # export PATH 00:27:09.957 15:28:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:09.957 15:28:13 -- nvmf/common.sh@47 -- # : 0 00:27:09.957 15:28:13 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:09.957 15:28:13 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:09.957 15:28:13 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:09.957 15:28:13 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:09.957 15:28:13 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:09.957 15:28:13 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:09.957 15:28:13 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:09.957 15:28:13 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:09.957 15:28:13 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:27:09.957 15:28:13 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:27:09.957 15:28:13 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:27:09.957 15:28:13 -- host/dma.sh@18 -- # subsystem=0 00:27:09.957 15:28:13 -- host/dma.sh@93 -- # nvmftestinit 00:27:09.957 15:28:13 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:09.957 15:28:13 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:09.957 15:28:13 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:09.957 15:28:13 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:09.957 15:28:13 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:09.957 15:28:13 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:09.957 15:28:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:09.957 15:28:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:09.957 15:28:13 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:09.957 15:28:13 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:09.957 15:28:13 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:09.957 15:28:13 -- common/autotest_common.sh@10 -- # set +x 00:27:18.086 15:28:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:18.086 15:28:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:18.086 15:28:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:18.086 15:28:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:18.086 15:28:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:18.086 15:28:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:18.086 15:28:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:18.086 15:28:21 -- nvmf/common.sh@295 -- # net_devs=() 00:27:18.086 15:28:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:18.086 15:28:21 -- nvmf/common.sh@296 -- # e810=() 00:27:18.086 15:28:21 -- nvmf/common.sh@296 -- # local -ga e810 00:27:18.086 15:28:21 -- nvmf/common.sh@297 -- # x722=() 00:27:18.086 15:28:21 -- nvmf/common.sh@297 -- # local -ga x722 00:27:18.086 15:28:21 -- nvmf/common.sh@298 -- # mlx=() 00:27:18.086 15:28:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:18.086 15:28:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:18.086 15:28:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:18.086 15:28:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:18.086 15:28:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:18.086 15:28:21 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:18.086 15:28:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:18.086 15:28:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:18.086 15:28:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:27:18.086 Found 0000:18:00.0 (0x8086 - 0x1592) 00:27:18.086 15:28:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:18.086 15:28:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:18.086 15:28:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:27:18.086 Found 0000:18:00.1 (0x8086 - 0x1592) 00:27:18.086 15:28:21 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:18.086 15:28:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:18.086 15:28:21 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:27:18.086 15:28:21 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:27:18.086 15:28:21 -- nvmf/common.sh@377 -- # modinfo irdma 00:27:18.086 15:28:21 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:27:18.086 15:28:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:18.086 15:28:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.086 15:28:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:18.086 15:28:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.086 15:28:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:27:18.086 Found net devices under 0000:18:00.0: cvl_0_0 00:27:18.086 15:28:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.086 15:28:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.087 15:28:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:18.087 15:28:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.087 15:28:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:27:18.087 Found net devices under 0000:18:00.1: cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.087 15:28:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:18.087 15:28:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:18.087 15:28:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:18.087 15:28:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:18.087 15:28:21 -- nvmf/common.sh@58 -- # uname 00:27:18.087 15:28:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:18.087 15:28:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:18.087 15:28:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:18.087 15:28:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:18.087 15:28:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:18.087 15:28:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:18.087 15:28:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:18.087 15:28:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:18.087 15:28:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:18.087 15:28:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:18.087 15:28:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:18.087 15:28:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:18.087 15:28:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:18.087 15:28:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:18.087 15:28:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:18.087 15:28:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:18.087 15:28:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@105 -- # continue 2 00:27:18.087 15:28:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@105 -- # continue 2 00:27:18.087 15:28:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:18.087 15:28:21 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:18.087 15:28:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:18.087 15:28:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:27:18.087 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:18.087 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:27:18.087 altname enp24s0f0np0 00:27:18.087 altname ens785f0np0 00:27:18.087 inet 192.168.100.8/24 scope global cvl_0_0 00:27:18.087 valid_lft forever preferred_lft forever 00:27:18.087 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:27:18.087 valid_lft forever preferred_lft forever 00:27:18.087 15:28:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:18.087 15:28:21 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:18.087 15:28:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:18.087 15:28:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:27:18.087 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:18.087 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:27:18.087 altname enp24s0f1np1 00:27:18.087 altname ens785f1np1 00:27:18.087 inet 192.168.100.9/24 scope global cvl_0_1 00:27:18.087 valid_lft forever preferred_lft forever 00:27:18.087 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:27:18.087 valid_lft forever preferred_lft forever 00:27:18.087 15:28:21 -- nvmf/common.sh@411 -- # return 0 00:27:18.087 15:28:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:18.087 15:28:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:18.087 15:28:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:18.087 15:28:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:18.087 15:28:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:18.087 15:28:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:18.087 15:28:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:18.087 15:28:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:18.087 15:28:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:18.087 15:28:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@105 -- # continue 2 00:27:18.087 15:28:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:18.087 15:28:21 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:18.087 15:28:21 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@105 -- # continue 2 00:27:18.087 15:28:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:18.087 15:28:21 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:18.087 15:28:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:18.087 15:28:21 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:18.087 15:28:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:18.087 15:28:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:18.087 192.168.100.9' 00:27:18.087 15:28:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:18.087 192.168.100.9' 00:27:18.087 15:28:21 -- nvmf/common.sh@446 -- # head -n 1 00:27:18.087 15:28:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:18.087 15:28:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:18.087 192.168.100.9' 00:27:18.087 15:28:21 -- nvmf/common.sh@447 -- # tail -n +2 00:27:18.087 15:28:21 -- nvmf/common.sh@447 -- # head -n 1 00:27:18.087 15:28:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:18.087 15:28:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:18.087 15:28:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:18.087 15:28:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:18.087 15:28:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:18.087 15:28:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:18.087 15:28:21 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:27:18.087 15:28:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:18.087 15:28:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:18.087 15:28:21 -- common/autotest_common.sh@10 -- # set +x 00:27:18.087 15:28:21 -- nvmf/common.sh@470 -- # nvmfpid=750343 00:27:18.087 15:28:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:27:18.087 15:28:21 -- nvmf/common.sh@471 -- # waitforlisten 750343 00:27:18.087 15:28:21 -- common/autotest_common.sh@817 -- # '[' -z 750343 ']' 00:27:18.087 15:28:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.087 15:28:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:18.087 15:28:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.087 15:28:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:18.087 15:28:21 -- common/autotest_common.sh@10 -- # set +x 00:27:18.087 [2024-04-24 15:28:21.405185] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:18.087 [2024-04-24 15:28:21.405242] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.087 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.087 [2024-04-24 15:28:21.484193] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:18.087 [2024-04-24 15:28:21.559517] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.087 [2024-04-24 15:28:21.559564] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.087 [2024-04-24 15:28:21.559585] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:18.087 [2024-04-24 15:28:21.559593] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:18.087 [2024-04-24 15:28:21.559600] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.087 [2024-04-24 15:28:21.559656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:18.087 [2024-04-24 15:28:21.559658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:18.346 15:28:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:18.346 15:28:22 -- common/autotest_common.sh@850 -- # return 0 00:27:18.346 15:28:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:18.346 15:28:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:18.346 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.346 15:28:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:18.346 15:28:22 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:18.346 15:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:18.346 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.604 [2024-04-24 15:28:22.268628] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xa022e0/0xa01920) succeed. 00:27:18.604 [2024-04-24 15:28:22.277734] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xa03590/0xa01ea0) succeed. 00:27:18.604 [2024-04-24 15:28:22.277759] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:27:18.604 15:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:18.604 15:28:22 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:27:18.604 15:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:18.604 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.604 Malloc0 00:27:18.604 15:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:18.604 15:28:22 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:27:18.604 15:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:18.604 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.604 15:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:18.604 15:28:22 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:27:18.604 15:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:18.604 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.604 15:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:18.604 15:28:22 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:18.604 15:28:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:18.604 15:28:22 -- common/autotest_common.sh@10 -- # set +x 00:27:18.604 [2024-04-24 15:28:22.366306] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:18.604 15:28:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:18.604 15:28:22 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:27:18.604 15:28:22 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:27:18.604 15:28:22 -- nvmf/common.sh@521 -- # config=() 00:27:18.604 15:28:22 -- nvmf/common.sh@521 -- # local subsystem config 00:27:18.604 15:28:22 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:18.605 15:28:22 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:18.605 { 00:27:18.605 "params": { 00:27:18.605 "name": "Nvme$subsystem", 00:27:18.605 "trtype": "$TEST_TRANSPORT", 00:27:18.605 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:18.605 "adrfam": "ipv4", 00:27:18.605 "trsvcid": "$NVMF_PORT", 00:27:18.605 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:18.605 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:18.605 "hdgst": ${hdgst:-false}, 00:27:18.605 "ddgst": ${ddgst:-false} 00:27:18.605 }, 00:27:18.605 "method": "bdev_nvme_attach_controller" 00:27:18.605 } 00:27:18.605 EOF 00:27:18.605 )") 00:27:18.605 15:28:22 -- nvmf/common.sh@543 -- # cat 00:27:18.605 15:28:22 -- nvmf/common.sh@545 -- # jq . 00:27:18.605 15:28:22 -- nvmf/common.sh@546 -- # IFS=, 00:27:18.605 15:28:22 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:27:18.605 "params": { 00:27:18.605 "name": "Nvme0", 00:27:18.605 "trtype": "rdma", 00:27:18.605 "traddr": "192.168.100.8", 00:27:18.605 "adrfam": "ipv4", 00:27:18.605 "trsvcid": "4420", 00:27:18.605 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:18.605 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:18.605 "hdgst": false, 00:27:18.605 "ddgst": false 00:27:18.605 }, 00:27:18.605 "method": "bdev_nvme_attach_controller" 00:27:18.605 }' 00:27:18.605 [2024-04-24 15:28:22.413970] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:18.605 [2024-04-24 15:28:22.414023] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid750403 ] 00:27:18.605 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.605 [2024-04-24 15:28:22.491348] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:18.863 [2024-04-24 15:28:22.568975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:18.863 [2024-04-24 15:28:22.568977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:24.135 bdev Nvme0n1 reports 1 memory domains 00:27:24.135 bdev Nvme0n1 supports RDMA memory domain 00:27:24.135 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:24.135 ========================================================================== 00:27:24.135 Latency [us] 00:27:24.135 IOPS MiB/s Average min max 00:27:24.135 Core 2: 21594.86 84.35 740.17 257.36 10656.38 00:27:24.135 Core 3: 21958.82 85.78 727.88 242.56 10454.05 00:27:24.135 ========================================================================== 00:27:24.135 Total : 43553.69 170.13 733.98 242.56 10656.38 00:27:24.135 00:27:24.135 Total operations: 217794, translate 217794 pull_push 0 memzero 0 00:27:24.135 15:28:28 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:27:24.135 15:28:28 -- host/dma.sh@107 -- # gen_malloc_json 00:27:24.135 15:28:28 -- host/dma.sh@21 -- # jq . 00:27:24.393 [2024-04-24 15:28:28.049958] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:24.393 [2024-04-24 15:28:28.050015] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid751131 ] 00:27:24.393 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.393 [2024-04-24 15:28:28.128227] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:24.393 [2024-04-24 15:28:28.203399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:24.393 [2024-04-24 15:28:28.203401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:29.665 bdev Malloc0 reports 2 memory domains 00:27:29.665 bdev Malloc0 doesn't support RDMA memory domain 00:27:29.665 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:29.666 ========================================================================== 00:27:29.666 Latency [us] 00:27:29.666 IOPS MiB/s Average min max 00:27:29.666 Core 2: 14507.14 56.67 1102.15 364.18 2233.23 00:27:29.666 Core 3: 14619.90 57.11 1093.61 432.00 2171.12 00:27:29.666 ========================================================================== 00:27:29.666 Total : 29127.04 113.78 1097.86 364.18 2233.23 00:27:29.666 00:27:29.666 Total operations: 145688, translate 0 pull_push 582752 memzero 0 00:27:29.666 15:28:33 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:27:29.666 15:28:33 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:27:29.666 15:28:33 -- host/dma.sh@48 -- # local subsystem=0 00:27:29.666 15:28:33 -- host/dma.sh@50 -- # jq . 00:27:29.925 Ignoring -M option 00:27:29.925 [2024-04-24 15:28:33.615722] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:29.925 [2024-04-24 15:28:33.615805] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid751849 ] 00:27:29.925 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.925 [2024-04-24 15:28:33.696381] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:29.925 [2024-04-24 15:28:33.772147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:29.925 [2024-04-24 15:28:33.772150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:30.184 [2024-04-24 15:28:33.981156] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:35.467 [2024-04-24 15:28:39.010918] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:35.467 bdev 0aab99fa-f567-46d9-bc90-441c40e9e23d reports 1 memory domains 00:27:35.467 bdev 0aab99fa-f567-46d9-bc90-441c40e9e23d supports RDMA memory domain 00:27:35.467 Initialization complete, running randread IO for 5 sec on 2 cores 00:27:35.467 ========================================================================== 00:27:35.467 Latency [us] 00:27:35.467 IOPS MiB/s Average min max 00:27:35.467 Core 2: 80536.21 314.59 197.96 66.07 3430.09 00:27:35.467 Core 3: 81672.08 319.03 195.18 69.07 3504.02 00:27:35.467 ========================================================================== 00:27:35.467 Total : 162208.29 633.63 196.56 66.07 3504.02 00:27:35.467 00:27:35.467 Total operations: 811136, translate 0 pull_push 0 memzero 811136 00:27:35.467 15:28:39 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:27:35.467 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.467 [2024-04-24 15:28:39.359744] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:27:38.005 Initializing NVMe Controllers 00:27:38.005 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:27:38.005 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:27:38.005 Initialization complete. Launching workers. 00:27:38.005 ======================================================== 00:27:38.005 Latency(us) 00:27:38.005 Device Information : IOPS MiB/s Average min max 00:27:38.005 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2024.68 7.91 7964.43 4669.37 10973.38 00:27:38.005 ======================================================== 00:27:38.005 Total : 2024.68 7.91 7964.43 4669.37 10973.38 00:27:38.005 00:27:38.005 15:28:41 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:27:38.005 15:28:41 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:27:38.005 15:28:41 -- host/dma.sh@48 -- # local subsystem=0 00:27:38.005 15:28:41 -- host/dma.sh@50 -- # jq . 00:27:38.005 [2024-04-24 15:28:41.703682] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:38.005 [2024-04-24 15:28:41.703736] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid752852 ] 00:27:38.005 EAL: No free 2048 kB hugepages reported on node 1 00:27:38.005 [2024-04-24 15:28:41.778922] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:38.005 [2024-04-24 15:28:41.857446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:38.005 [2024-04-24 15:28:41.857447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:38.264 [2024-04-24 15:28:42.073466] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:43.540 [2024-04-24 15:28:47.102231] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:43.540 bdev 0bb92370-bd59-4833-a003-9edc71afa011 reports 1 memory domains 00:27:43.540 bdev 0bb92370-bd59-4833-a003-9edc71afa011 supports RDMA memory domain 00:27:43.540 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:43.540 ========================================================================== 00:27:43.540 Latency [us] 00:27:43.540 IOPS MiB/s Average min max 00:27:43.540 Core 2: 20159.39 78.75 793.02 32.59 16610.25 00:27:43.540 Core 3: 19894.04 77.71 803.58 10.69 16431.67 00:27:43.540 ========================================================================== 00:27:43.540 Total : 40053.43 156.46 798.27 10.69 16610.25 00:27:43.540 00:27:43.540 Total operations: 200309, translate 200206 pull_push 0 memzero 103 00:27:43.540 15:28:47 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:27:43.540 15:28:47 -- host/dma.sh@120 -- # nvmftestfini 00:27:43.540 15:28:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:43.540 15:28:47 -- nvmf/common.sh@117 -- # sync 00:27:43.540 15:28:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:43.540 15:28:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:43.540 15:28:47 -- nvmf/common.sh@120 -- # set +e 00:27:43.540 15:28:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:43.540 15:28:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:43.540 rmmod nvme_rdma 00:27:43.540 rmmod nvme_fabrics 00:27:43.540 15:28:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:43.540 15:28:47 -- nvmf/common.sh@124 -- # set -e 00:27:43.540 15:28:47 -- nvmf/common.sh@125 -- # return 0 00:27:43.540 15:28:47 -- nvmf/common.sh@478 -- # '[' -n 750343 ']' 00:27:43.540 15:28:47 -- nvmf/common.sh@479 -- # killprocess 750343 00:27:43.540 15:28:47 -- common/autotest_common.sh@936 -- # '[' -z 750343 ']' 00:27:43.540 15:28:47 -- common/autotest_common.sh@940 -- # kill -0 750343 00:27:43.540 15:28:47 -- common/autotest_common.sh@941 -- # uname 00:27:43.540 15:28:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:43.540 15:28:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 750343 00:27:43.540 15:28:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:43.540 15:28:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:43.540 15:28:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 750343' 00:27:43.540 killing process with pid 750343 00:27:43.540 15:28:47 -- common/autotest_common.sh@955 -- # kill 750343 00:27:43.540 15:28:47 -- common/autotest_common.sh@960 -- # wait 750343 00:27:43.799 [2024-04-24 15:28:47.474259] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:44.059 15:28:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:44.059 15:28:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:44.059 00:27:44.059 real 0m34.242s 00:27:44.059 user 1m37.601s 00:27:44.059 sys 0m7.212s 00:27:44.059 15:28:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:44.059 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:44.059 ************************************ 00:27:44.059 END TEST dma 00:27:44.059 ************************************ 00:27:44.059 15:28:47 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:44.059 15:28:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:44.059 15:28:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:44.059 15:28:47 -- common/autotest_common.sh@10 -- # set +x 00:27:44.059 ************************************ 00:27:44.059 START TEST nvmf_identify 00:27:44.059 ************************************ 00:27:44.059 15:28:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:44.319 * Looking for test storage... 00:27:44.319 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:44.319 15:28:48 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:44.319 15:28:48 -- nvmf/common.sh@7 -- # uname -s 00:27:44.319 15:28:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:44.319 15:28:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:44.319 15:28:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:44.319 15:28:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:44.319 15:28:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:44.319 15:28:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:44.319 15:28:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:44.319 15:28:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:44.319 15:28:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:44.319 15:28:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:44.319 15:28:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:27:44.319 15:28:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:27:44.319 15:28:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:44.319 15:28:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:44.319 15:28:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:44.319 15:28:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:44.319 15:28:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:44.319 15:28:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:44.319 15:28:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:44.319 15:28:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:44.319 15:28:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:44.319 15:28:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:44.319 15:28:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:44.319 15:28:48 -- paths/export.sh@5 -- # export PATH 00:27:44.320 15:28:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:44.320 15:28:48 -- nvmf/common.sh@47 -- # : 0 00:27:44.320 15:28:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:44.320 15:28:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:44.320 15:28:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:44.320 15:28:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:44.320 15:28:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:44.320 15:28:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:44.320 15:28:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:44.320 15:28:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:44.320 15:28:48 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:44.320 15:28:48 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:44.320 15:28:48 -- host/identify.sh@14 -- # nvmftestinit 00:27:44.320 15:28:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:44.320 15:28:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:44.320 15:28:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:44.320 15:28:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:44.320 15:28:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:44.320 15:28:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:44.320 15:28:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:44.320 15:28:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:44.320 15:28:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:44.320 15:28:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:44.320 15:28:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:44.320 15:28:48 -- common/autotest_common.sh@10 -- # set +x 00:27:52.445 15:28:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:52.445 15:28:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:52.445 15:28:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:52.445 15:28:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:52.445 15:28:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:52.445 15:28:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:52.445 15:28:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:52.445 15:28:54 -- nvmf/common.sh@295 -- # net_devs=() 00:27:52.445 15:28:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:52.445 15:28:54 -- nvmf/common.sh@296 -- # e810=() 00:27:52.445 15:28:54 -- nvmf/common.sh@296 -- # local -ga e810 00:27:52.445 15:28:54 -- nvmf/common.sh@297 -- # x722=() 00:27:52.445 15:28:54 -- nvmf/common.sh@297 -- # local -ga x722 00:27:52.445 15:28:54 -- nvmf/common.sh@298 -- # mlx=() 00:27:52.445 15:28:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:52.445 15:28:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:52.445 15:28:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:27:52.445 Found 0000:18:00.0 (0x8086 - 0x1592) 00:27:52.445 15:28:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:52.445 15:28:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:27:52.445 Found 0000:18:00.1 (0x8086 - 0x1592) 00:27:52.445 15:28:55 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:52.445 15:28:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@377 -- # modinfo irdma 00:27:52.445 15:28:55 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:27:52.445 15:28:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:52.445 15:28:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:52.445 15:28:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:27:52.445 Found net devices under 0000:18:00.0: cvl_0_0 00:27:52.445 15:28:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:52.445 15:28:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:52.445 15:28:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:27:52.445 Found net devices under 0000:18:00.1: cvl_0_1 00:27:52.445 15:28:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:52.445 15:28:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:52.445 15:28:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:52.445 15:28:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:52.445 15:28:55 -- nvmf/common.sh@58 -- # uname 00:27:52.445 15:28:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:52.445 15:28:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:52.445 15:28:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:52.445 15:28:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:52.445 15:28:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:52.445 15:28:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:52.445 15:28:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:52.445 15:28:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:52.445 15:28:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:52.445 15:28:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:52.445 15:28:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:52.445 15:28:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:52.445 15:28:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:52.445 15:28:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:52.445 15:28:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:52.445 15:28:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:52.445 15:28:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:52.445 15:28:55 -- nvmf/common.sh@105 -- # continue 2 00:27:52.445 15:28:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.445 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:52.445 15:28:55 -- nvmf/common.sh@105 -- # continue 2 00:27:52.445 15:28:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:52.445 15:28:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:27:52.445 15:28:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:52.445 15:28:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:52.445 15:28:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:27:52.445 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:52.445 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:27:52.445 altname enp24s0f0np0 00:27:52.445 altname ens785f0np0 00:27:52.445 inet 192.168.100.8/24 scope global cvl_0_0 00:27:52.445 valid_lft forever preferred_lft forever 00:27:52.445 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:27:52.445 valid_lft forever preferred_lft forever 00:27:52.445 15:28:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:52.445 15:28:55 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:27:52.445 15:28:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:52.445 15:28:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:52.445 15:28:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:52.445 15:28:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:52.445 15:28:55 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:27:52.445 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:27:52.445 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:27:52.445 altname enp24s0f1np1 00:27:52.445 altname ens785f1np1 00:27:52.445 inet 192.168.100.9/24 scope global cvl_0_1 00:27:52.445 valid_lft forever preferred_lft forever 00:27:52.445 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:27:52.445 valid_lft forever preferred_lft forever 00:27:52.446 15:28:55 -- nvmf/common.sh@411 -- # return 0 00:27:52.446 15:28:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:52.446 15:28:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:52.446 15:28:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:52.446 15:28:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:52.446 15:28:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:52.446 15:28:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:52.446 15:28:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:52.446 15:28:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:52.446 15:28:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:52.446 15:28:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:52.446 15:28:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:52.446 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.446 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:27:52.446 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.446 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:27:52.446 15:28:55 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:27:52.446 15:28:55 -- nvmf/common.sh@105 -- # continue 2 00:27:52.446 15:28:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:52.446 15:28:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:52.446 15:28:55 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:27:52.446 15:28:55 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:27:52.446 15:28:55 -- nvmf/common.sh@105 -- # continue 2 00:27:52.446 15:28:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:52.446 15:28:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:27:52.446 15:28:55 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:52.446 15:28:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:52.446 15:28:55 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:27:52.446 15:28:55 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:52.446 15:28:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:52.446 15:28:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:52.446 192.168.100.9' 00:27:52.446 15:28:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:52.446 192.168.100.9' 00:27:52.446 15:28:55 -- nvmf/common.sh@446 -- # head -n 1 00:27:52.446 15:28:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:52.446 15:28:55 -- nvmf/common.sh@447 -- # tail -n +2 00:27:52.446 15:28:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:52.446 192.168.100.9' 00:27:52.446 15:28:55 -- nvmf/common.sh@447 -- # head -n 1 00:27:52.446 15:28:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:52.446 15:28:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:52.446 15:28:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:52.446 15:28:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:52.446 15:28:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:52.446 15:28:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:52.446 15:28:55 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:27:52.446 15:28:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:52.446 15:28:55 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 15:28:55 -- host/identify.sh@19 -- # nvmfpid=756926 00:27:52.446 15:28:55 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:52.446 15:28:55 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:52.446 15:28:55 -- host/identify.sh@23 -- # waitforlisten 756926 00:27:52.446 15:28:55 -- common/autotest_common.sh@817 -- # '[' -z 756926 ']' 00:27:52.446 15:28:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:52.446 15:28:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:52.446 15:28:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:52.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:52.446 15:28:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:52.446 15:28:55 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 [2024-04-24 15:28:55.309196] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:52.446 [2024-04-24 15:28:55.309249] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:52.446 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.446 [2024-04-24 15:28:55.391612] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:52.446 [2024-04-24 15:28:55.476118] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:52.446 [2024-04-24 15:28:55.476161] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:52.446 [2024-04-24 15:28:55.476171] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:52.446 [2024-04-24 15:28:55.476179] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:52.446 [2024-04-24 15:28:55.476186] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:52.446 [2024-04-24 15:28:55.476233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:52.446 [2024-04-24 15:28:55.476318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:52.446 [2024-04-24 15:28:55.476393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:52.446 [2024-04-24 15:28:55.476395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:52.446 15:28:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:52.446 15:28:56 -- common/autotest_common.sh@850 -- # return 0 00:27:52.446 15:28:56 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 [2024-04-24 15:28:56.144733] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1626910/0x1625f50) succeed. 00:27:52.446 [2024-04-24 15:28:56.155353] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1627c80/0x16264d0) succeed. 00:27:52.446 [2024-04-24 15:28:56.155387] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:27:52.446 15:28:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 15:28:56 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 Malloc0 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 [2024-04-24 15:28:56.257156] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.446 15:28:56 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:27:52.446 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.446 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.446 [2024-04-24 15:28:56.273085] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:52.446 [ 00:27:52.446 { 00:27:52.446 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:52.446 "subtype": "Discovery", 00:27:52.446 "listen_addresses": [ 00:27:52.446 { 00:27:52.446 "transport": "RDMA", 00:27:52.446 "trtype": "RDMA", 00:27:52.446 "adrfam": "IPv4", 00:27:52.446 "traddr": "192.168.100.8", 00:27:52.446 "trsvcid": "4420" 00:27:52.446 } 00:27:52.446 ], 00:27:52.446 "allow_any_host": true, 00:27:52.446 "hosts": [] 00:27:52.446 }, 00:27:52.446 { 00:27:52.446 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:52.446 "subtype": "NVMe", 00:27:52.446 "listen_addresses": [ 00:27:52.446 { 00:27:52.446 "transport": "RDMA", 00:27:52.446 "trtype": "RDMA", 00:27:52.446 "adrfam": "IPv4", 00:27:52.446 "traddr": "192.168.100.8", 00:27:52.446 "trsvcid": "4420" 00:27:52.446 } 00:27:52.446 ], 00:27:52.446 "allow_any_host": true, 00:27:52.446 "hosts": [], 00:27:52.446 "serial_number": "SPDK00000000000001", 00:27:52.446 "model_number": "SPDK bdev Controller", 00:27:52.446 "max_namespaces": 32, 00:27:52.446 "min_cntlid": 1, 00:27:52.446 "max_cntlid": 65519, 00:27:52.446 "namespaces": [ 00:27:52.446 { 00:27:52.446 "nsid": 1, 00:27:52.446 "bdev_name": "Malloc0", 00:27:52.446 "name": "Malloc0", 00:27:52.446 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:27:52.446 "eui64": "ABCDEF0123456789", 00:27:52.446 "uuid": "b4af71f3-b19c-4fbd-833f-2f3892d7898c" 00:27:52.446 } 00:27:52.446 ] 00:27:52.446 } 00:27:52.446 ] 00:27:52.446 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.447 15:28:56 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:27:52.447 [2024-04-24 15:28:56.317070] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:52.447 [2024-04-24 15:28:56.317112] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757120 ] 00:27:52.447 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.447 [2024-04-24 15:28:56.355712] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:27:52.447 [2024-04-24 15:28:56.355789] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:27:52.447 [2024-04-24 15:28:56.355803] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:27:52.447 [2024-04-24 15:28:56.355808] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:27:52.447 [2024-04-24 15:28:56.355838] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:27:52.712 [2024-04-24 15:28:56.363739] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:27:52.712 [2024-04-24 15:28:56.378084] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:52.712 [2024-04-24 15:28:56.378095] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:27:52.712 [2024-04-24 15:28:56.378104] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378111] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378118] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378124] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378131] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378140] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378147] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378153] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378159] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378165] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378172] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378178] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378184] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378191] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378197] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378203] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378209] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x72831fbe 00:27:52.712 [2024-04-24 15:28:56.378216] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378222] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378228] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378235] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378241] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378247] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378253] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378260] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378266] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378272] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378278] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378285] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378291] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378297] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378303] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:27:52.713 [2024-04-24 15:28:56.378309] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:52.713 [2024-04-24 15:28:56.378313] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:27:52.713 [2024-04-24 15:28:56.378330] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.378344] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383490] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383508] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383516] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:52.713 [2024-04-24 15:28:56.383523] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:27:52.713 [2024-04-24 15:28:56.383529] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:27:52.713 [2024-04-24 15:28:56.383544] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383552] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.383586] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383601] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:27:52.713 [2024-04-24 15:28:56.383607] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383614] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:27:52.713 [2024-04-24 15:28:56.383622] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383630] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.383654] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383666] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:27:52.713 [2024-04-24 15:28:56.383672] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383680] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383687] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383695] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.383721] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383733] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383739] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383748] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383755] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.383783] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383797] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:27:52.713 [2024-04-24 15:28:56.383803] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383809] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383816] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383923] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:27:52.713 [2024-04-24 15:28:56.383929] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383938] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383946] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.383970] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.383976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.383982] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:52.713 [2024-04-24 15:28:56.383989] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.383997] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384005] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.384032] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.384038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.384044] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:52.713 [2024-04-24 15:28:56.384050] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:27:52.713 [2024-04-24 15:28:56.384056] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384063] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:27:52.713 [2024-04-24 15:28:56.384072] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:27:52.713 [2024-04-24 15:28:56.384082] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384129] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.384135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.384146] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:27:52.713 [2024-04-24 15:28:56.384153] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:27:52.713 [2024-04-24 15:28:56.384159] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:27:52.713 [2024-04-24 15:28:56.384168] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 6 00:27:52.713 [2024-04-24 15:28:56.384175] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:27:52.713 [2024-04-24 15:28:56.384181] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:27:52.713 [2024-04-24 15:28:56.384187] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384194] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:27:52.713 [2024-04-24 15:28:56.384202] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384210] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.713 [2024-04-24 15:28:56.384237] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.713 [2024-04-24 15:28:56.384242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:27:52.713 [2024-04-24 15:28:56.384251] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x72831fbe 00:27:52.713 [2024-04-24 15:28:56.384258] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.714 [2024-04-24 15:28:56.384265] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.714 [2024-04-24 15:28:56.384280] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.714 [2024-04-24 15:28:56.384294] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.714 [2024-04-24 15:28:56.384306] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:27:52.714 [2024-04-24 15:28:56.384312] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384323] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:52.714 [2024-04-24 15:28:56.384330] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384338] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.714 [2024-04-24 15:28:56.384361] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384376] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:27:52.714 [2024-04-24 15:28:56.384383] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:27:52.714 [2024-04-24 15:28:56.384389] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384398] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384436] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384449] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384459] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:27:52.714 [2024-04-24 15:28:56.384478] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384490] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384499] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.714 [2024-04-24 15:28:56.384526] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384543] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384557] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384563] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384575] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384590] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384606] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384613] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384620] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x72831fbe 00:27:52.714 [2024-04-24 15:28:56.384644] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.714 [2024-04-24 15:28:56.384649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:27:52.714 [2024-04-24 15:28:56.384662] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x72831fbe 00:27:52.714 ===================================================== 00:27:52.714 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:27:52.714 ===================================================== 00:27:52.714 Controller Capabilities/Features 00:27:52.714 ================================ 00:27:52.714 Vendor ID: 0000 00:27:52.714 Subsystem Vendor ID: 0000 00:27:52.714 Serial Number: .................... 00:27:52.714 Model Number: ........................................ 00:27:52.714 Firmware Version: 24.05 00:27:52.714 Recommended Arb Burst: 0 00:27:52.714 IEEE OUI Identifier: 00 00 00 00:27:52.714 Multi-path I/O 00:27:52.714 May have multiple subsystem ports: No 00:27:52.714 May have multiple controllers: No 00:27:52.714 Associated with SR-IOV VF: No 00:27:52.714 Max Data Transfer Size: 131072 00:27:52.714 Max Number of Namespaces: 0 00:27:52.714 Max Number of I/O Queues: 1024 00:27:52.714 NVMe Specification Version (VS): 1.3 00:27:52.714 NVMe Specification Version (Identify): 1.3 00:27:52.714 Maximum Queue Entries: 128 00:27:52.714 Contiguous Queues Required: Yes 00:27:52.714 Arbitration Mechanisms Supported 00:27:52.714 Weighted Round Robin: Not Supported 00:27:52.714 Vendor Specific: Not Supported 00:27:52.714 Reset Timeout: 15000 ms 00:27:52.714 Doorbell Stride: 4 bytes 00:27:52.714 NVM Subsystem Reset: Not Supported 00:27:52.714 Command Sets Supported 00:27:52.714 NVM Command Set: Supported 00:27:52.714 Boot Partition: Not Supported 00:27:52.714 Memory Page Size Minimum: 4096 bytes 00:27:52.714 Memory Page Size Maximum: 4096 bytes 00:27:52.714 Persistent Memory Region: Not Supported 00:27:52.714 Optional Asynchronous Events Supported 00:27:52.714 Namespace Attribute Notices: Not Supported 00:27:52.714 Firmware Activation Notices: Not Supported 00:27:52.714 ANA Change Notices: Not Supported 00:27:52.714 PLE Aggregate Log Change Notices: Not Supported 00:27:52.714 LBA Status Info Alert Notices: Not Supported 00:27:52.714 EGE Aggregate Log Change Notices: Not Supported 00:27:52.714 Normal NVM Subsystem Shutdown event: Not Supported 00:27:52.714 Zone Descriptor Change Notices: Not Supported 00:27:52.714 Discovery Log Change Notices: Supported 00:27:52.714 Controller Attributes 00:27:52.714 128-bit Host Identifier: Not Supported 00:27:52.714 Non-Operational Permissive Mode: Not Supported 00:27:52.714 NVM Sets: Not Supported 00:27:52.714 Read Recovery Levels: Not Supported 00:27:52.714 Endurance Groups: Not Supported 00:27:52.714 Predictable Latency Mode: Not Supported 00:27:52.714 Traffic Based Keep ALive: Not Supported 00:27:52.714 Namespace Granularity: Not Supported 00:27:52.714 SQ Associations: Not Supported 00:27:52.714 UUID List: Not Supported 00:27:52.714 Multi-Domain Subsystem: Not Supported 00:27:52.714 Fixed Capacity Management: Not Supported 00:27:52.714 Variable Capacity Management: Not Supported 00:27:52.714 Delete Endurance Group: Not Supported 00:27:52.714 Delete NVM Set: Not Supported 00:27:52.714 Extended LBA Formats Supported: Not Supported 00:27:52.714 Flexible Data Placement Supported: Not Supported 00:27:52.714 00:27:52.714 Controller Memory Buffer Support 00:27:52.714 ================================ 00:27:52.714 Supported: No 00:27:52.714 00:27:52.714 Persistent Memory Region Support 00:27:52.714 ================================ 00:27:52.714 Supported: No 00:27:52.714 00:27:52.714 Admin Command Set Attributes 00:27:52.714 ============================ 00:27:52.714 Security Send/Receive: Not Supported 00:27:52.714 Format NVM: Not Supported 00:27:52.714 Firmware Activate/Download: Not Supported 00:27:52.714 Namespace Management: Not Supported 00:27:52.714 Device Self-Test: Not Supported 00:27:52.714 Directives: Not Supported 00:27:52.714 NVMe-MI: Not Supported 00:27:52.714 Virtualization Management: Not Supported 00:27:52.714 Doorbell Buffer Config: Not Supported 00:27:52.714 Get LBA Status Capability: Not Supported 00:27:52.714 Command & Feature Lockdown Capability: Not Supported 00:27:52.714 Abort Command Limit: 1 00:27:52.714 Async Event Request Limit: 4 00:27:52.714 Number of Firmware Slots: N/A 00:27:52.714 Firmware Slot 1 Read-Only: N/A 00:27:52.714 Firmware Activation Without Reset: N/A 00:27:52.714 Multiple Update Detection Support: N/A 00:27:52.714 Firmware Update Granularity: No Information Provided 00:27:52.714 Per-Namespace SMART Log: No 00:27:52.714 Asymmetric Namespace Access Log Page: Not Supported 00:27:52.714 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:27:52.714 Command Effects Log Page: Not Supported 00:27:52.714 Get Log Page Extended Data: Supported 00:27:52.715 Telemetry Log Pages: Not Supported 00:27:52.715 Persistent Event Log Pages: Not Supported 00:27:52.715 Supported Log Pages Log Page: May Support 00:27:52.715 Commands Supported & Effects Log Page: Not Supported 00:27:52.715 Feature Identifiers & Effects Log Page:May Support 00:27:52.715 NVMe-MI Commands & Effects Log Page: May Support 00:27:52.715 Data Area 4 for Telemetry Log: Not Supported 00:27:52.715 Error Log Page Entries Supported: 128 00:27:52.715 Keep Alive: Not Supported 00:27:52.715 00:27:52.715 NVM Command Set Attributes 00:27:52.715 ========================== 00:27:52.715 Submission Queue Entry Size 00:27:52.715 Max: 1 00:27:52.715 Min: 1 00:27:52.715 Completion Queue Entry Size 00:27:52.715 Max: 1 00:27:52.715 Min: 1 00:27:52.715 Number of Namespaces: 0 00:27:52.715 Compare Command: Not Supported 00:27:52.715 Write Uncorrectable Command: Not Supported 00:27:52.715 Dataset Management Command: Not Supported 00:27:52.715 Write Zeroes Command: Not Supported 00:27:52.715 Set Features Save Field: Not Supported 00:27:52.715 Reservations: Not Supported 00:27:52.715 Timestamp: Not Supported 00:27:52.715 Copy: Not Supported 00:27:52.715 Volatile Write Cache: Not Present 00:27:52.715 Atomic Write Unit (Normal): 1 00:27:52.715 Atomic Write Unit (PFail): 1 00:27:52.715 Atomic Compare & Write Unit: 1 00:27:52.715 Fused Compare & Write: Supported 00:27:52.715 Scatter-Gather List 00:27:52.715 SGL Command Set: Supported 00:27:52.715 SGL Keyed: Supported 00:27:52.715 SGL Bit Bucket Descriptor: Not Supported 00:27:52.715 SGL Metadata Pointer: Not Supported 00:27:52.715 Oversized SGL: Not Supported 00:27:52.715 SGL Metadata Address: Not Supported 00:27:52.715 SGL Offset: Supported 00:27:52.715 Transport SGL Data Block: Not Supported 00:27:52.715 Replay Protected Memory Block: Not Supported 00:27:52.715 00:27:52.715 Firmware Slot Information 00:27:52.715 ========================= 00:27:52.715 Active slot: 0 00:27:52.715 00:27:52.715 00:27:52.715 Error Log 00:27:52.715 ========= 00:27:52.715 00:27:52.715 Active Namespaces 00:27:52.715 ================= 00:27:52.715 Discovery Log Page 00:27:52.715 ================== 00:27:52.715 Generation Counter: 2 00:27:52.715 Number of Records: 2 00:27:52.715 Record Format: 0 00:27:52.715 00:27:52.715 Discovery Log Entry 0 00:27:52.715 ---------------------- 00:27:52.715 Transport Type: 1 (RDMA) 00:27:52.715 Address Family: 1 (IPv4) 00:27:52.715 Subsystem Type: 3 (Current Discovery Subsystem) 00:27:52.715 Entry Flags: 00:27:52.715 Duplicate Returned Information: 1 00:27:52.715 Explicit Persistent Connection Support for Discovery: 1 00:27:52.715 Transport Requirements: 00:27:52.715 Secure Channel: Not Required 00:27:52.715 Port ID: 0 (0x0000) 00:27:52.715 Controller ID: 65535 (0xffff) 00:27:52.715 Admin Max SQ Size: 128 00:27:52.715 Transport Service Identifier: 4420 00:27:52.715 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:27:52.715 Transport Address: 192.168.100.8 00:27:52.715 Transport Specific Address Subtype - RDMA 00:27:52.715 RDMA QP Service Type: 1 (Reliable Connected) 00:27:52.715 RDMA Provider Type: 1 (No provider specified) 00:27:52.715 RDMA CM Service: 1 (RDMA_CM) 00:27:52.715 Discovery Log Entry 1 00:27:52.715 ---------------------- 00:27:52.715 Transport Type: 1 (RDMA) 00:27:52.715 Address Family: 1 (IPv4) 00:27:52.715 Subsystem Type: 2 (NVM Subsystem) 00:27:52.715 Entry Flags: 00:27:52.715 Duplicate Returned Information: 0 00:27:52.715 Explicit Persistent Connection Support for Discovery: 0 00:27:52.715 Transport Requirements: 00:27:52.715 Secure Channel: Not Required 00:27:52.715 Port ID: 0 (0x0000) 00:27:52.715 Controller ID: 65535 (0xffff) 00:27:52.715 Admin Max SQ Size: [2024-04-24 15:28:56.384732] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:27:52.715 [2024-04-24 15:28:56.384742] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 10992 doesn't match qid 00:27:52.715 [2024-04-24 15:28:56.384757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32757 cdw0:5 sqhd:a790 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384764] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 10992 doesn't match qid 00:27:52.715 [2024-04-24 15:28:56.384772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32757 cdw0:5 sqhd:a790 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384779] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 10992 doesn't match qid 00:27:52.715 [2024-04-24 15:28:56.384787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32757 cdw0:5 sqhd:a790 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384794] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 10992 doesn't match qid 00:27:52.715 [2024-04-24 15:28:56.384801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32757 cdw0:5 sqhd:a790 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384811] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384819] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.384845] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.384851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384862] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384870] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.384876] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384906] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.384913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384919] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:27:52.715 [2024-04-24 15:28:56.384926] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:27:52.715 [2024-04-24 15:28:56.384932] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384940] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384948] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.384970] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.384977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.384983] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.384993] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385001] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.385025] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.385030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.385037] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385046] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385054] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.385078] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.385084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.385091] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385100] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385107] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.385133] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.385138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.385146] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385155] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.385187] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.385193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:52.715 [2024-04-24 15:28:56.385200] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.715 [2024-04-24 15:28:56.385218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.715 [2024-04-24 15:28:56.385241] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.715 [2024-04-24 15:28:56.385247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385253] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385262] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385270] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385298] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385311] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385320] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385357] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385370] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385378] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385407] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385419] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385428] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385436] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385459] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385471] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385479] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385492] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385515] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385527] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385536] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385571] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385583] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385592] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385599] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385625] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385637] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385645] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385654] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385678] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385690] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385699] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385706] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385731] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385743] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385753] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385760] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385787] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385799] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385808] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385815] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385840] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385852] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385861] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385890] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385902] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385911] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385941] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.385947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.385953] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385965] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.385973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.385998] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.386003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.386010] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386019] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386026] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.386049] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.386055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.386061] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386070] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386078] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.386101] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.386106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.386113] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386122] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.386152] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.386158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.386164] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386173] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.716 [2024-04-24 15:28:56.386181] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.716 [2024-04-24 15:28:56.386202] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.716 [2024-04-24 15:28:56.386207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:52.716 [2024-04-24 15:28:56.386214] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386223] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386230] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386251] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386265] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386274] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386281] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386310] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386322] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386331] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386338] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386361] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386374] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386382] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386390] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386413] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386425] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386434] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386441] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386462] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386474] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386483] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386496] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386536] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386545] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386581] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386595] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386604] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386634] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386646] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386655] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386663] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386690] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386702] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386711] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386718] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386747] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386759] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386768] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386775] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386798] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386810] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386819] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386827] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386852] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386864] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386873] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386880] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386909] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386922] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386931] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386939] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.717 [2024-04-24 15:28:56.386960] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.717 [2024-04-24 15:28:56.386965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:52.717 [2024-04-24 15:28:56.386972] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386981] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.717 [2024-04-24 15:28:56.386988] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387017] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387029] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387038] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387068] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387080] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387089] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387124] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387136] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387144] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387152] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387177] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387189] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387198] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387230] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387242] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387251] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387258] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387283] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387304] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387312] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387340] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387352] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387361] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387369] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387398] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387410] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387418] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387426] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.387451] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.387457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.387463] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387472] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.387479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.391494] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.391501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.391508] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.391517] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.391524] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.718 [2024-04-24 15:28:56.391553] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.718 [2024-04-24 15:28:56.391559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0002 p:0 m:0 dnr:0 00:27:52.718 [2024-04-24 15:28:56.391565] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x72831fbe 00:27:52.718 [2024-04-24 15:28:56.391572] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:27:52.718 128 00:27:52.718 Transport Service Identifier: 4420 00:27:52.718 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:27:52.718 Transport Address: 192.168.100.8 00:27:52.718 Transport Specific Address Subtype - RDMA 00:27:52.718 RDMA QP Service Type: 1 (Reliable Connected) 00:27:52.718 RDMA Provider Type: 1 (No provider specified) 00:27:52.718 RDMA CM Service: 1 (RDMA_CM) 00:27:52.718 15:28:56 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:27:52.718 [2024-04-24 15:28:56.458369] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:27:52.718 [2024-04-24 15:28:56.458409] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid757122 ] 00:27:52.718 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.718 [2024-04-24 15:28:56.495951] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:27:52.718 [2024-04-24 15:28:56.496023] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:27:52.718 [2024-04-24 15:28:56.496036] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:27:52.718 [2024-04-24 15:28:56.496041] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:27:52.718 [2024-04-24 15:28:56.496064] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:27:52.718 [2024-04-24 15:28:56.510779] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:27:52.718 [2024-04-24 15:28:56.525798] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:52.718 [2024-04-24 15:28:56.525809] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:27:52.718 [2024-04-24 15:28:56.525816] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525824] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525830] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525837] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525843] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525850] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525856] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525862] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525871] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525878] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525884] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525891] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525897] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525904] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525910] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525917] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525923] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525930] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0xabdcd4be 00:27:52.718 [2024-04-24 15:28:56.525936] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525942] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525949] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525955] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525962] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525968] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525975] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525981] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525987] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.525994] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.526000] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.526007] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.526013] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.526019] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:27:52.719 [2024-04-24 15:28:56.526025] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:27:52.719 [2024-04-24 15:28:56.526029] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:27:52.719 [2024-04-24 15:28:56.526044] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.526055] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531490] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531507] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531515] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:27:52.719 [2024-04-24 15:28:56.531523] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:27:52.719 [2024-04-24 15:28:56.531530] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:27:52.719 [2024-04-24 15:28:56.531542] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531551] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.531579] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531593] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:27:52.719 [2024-04-24 15:28:56.531600] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531606] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:27:52.719 [2024-04-24 15:28:56.531614] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531622] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.531651] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531663] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:27:52.719 [2024-04-24 15:28:56.531669] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531677] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531684] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531692] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.531716] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531728] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531734] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531743] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531751] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.531776] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531788] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:27:52.719 [2024-04-24 15:28:56.531794] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531802] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531809] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531916] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:27:52.719 [2024-04-24 15:28:56.531921] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531930] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.531959] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.531965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.531971] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:27:52.719 [2024-04-24 15:28:56.531977] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531986] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.531994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.532019] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.532025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.532031] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:27:52.719 [2024-04-24 15:28:56.532037] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:27:52.719 [2024-04-24 15:28:56.532043] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532050] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:27:52.719 [2024-04-24 15:28:56.532058] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:27:52.719 [2024-04-24 15:28:56.532068] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532131] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.532137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.532146] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:27:52.719 [2024-04-24 15:28:56.532152] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:27:52.719 [2024-04-24 15:28:56.532158] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:27:52.719 [2024-04-24 15:28:56.532166] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 6 00:27:52.719 [2024-04-24 15:28:56.532173] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:27:52.719 [2024-04-24 15:28:56.532180] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:27:52.719 [2024-04-24 15:28:56.532186] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532193] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:27:52.719 [2024-04-24 15:28:56.532201] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532209] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.719 [2024-04-24 15:28:56.532236] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.719 [2024-04-24 15:28:56.532242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:27:52.719 [2024-04-24 15:28:56.532250] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532257] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.719 [2024-04-24 15:28:56.532265] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0xabdcd4be 00:27:52.719 [2024-04-24 15:28:56.532272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.720 [2024-04-24 15:28:56.532279] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.720 [2024-04-24 15:28:56.532293] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.720 [2024-04-24 15:28:56.532306] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532312] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532323] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532330] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532338] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.532362] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532374] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:27:52.720 [2024-04-24 15:28:56.532380] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532386] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532394] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532402] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532410] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532417] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.532452] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532504] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532511] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532518] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532528] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532535] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532568] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532586] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:27:52.720 [2024-04-24 15:28:56.532600] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532607] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532615] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532623] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532666] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532684] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532691] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532698] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532707] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532714] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532744] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532760] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532766] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532774] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532782] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532790] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532796] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532803] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:27:52.720 [2024-04-24 15:28:56.532808] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:27:52.720 [2024-04-24 15:28:56.532815] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:27:52.720 [2024-04-24 15:28:56.532829] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532836] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.532844] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:27:52.720 [2024-04-24 15:28:56.532865] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532878] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532884] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532896] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532905] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532913] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.532938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.532950] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532959] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.532967] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.532992] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.532998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.533006] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533015] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533023] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.720 [2024-04-24 15:28:56.533046] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.720 [2024-04-24 15:28:56.533051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:27:52.720 [2024-04-24 15:28:56.533058] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533069] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533085] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533093] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533102] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533118] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0xabdcd4be 00:27:52.720 [2024-04-24 15:28:56.533125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0xabdcd4be 00:27:52.721 [2024-04-24 15:28:56.533134] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.721 [2024-04-24 15:28:56.533140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:27:52.721 [2024-04-24 15:28:56.533152] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0xabdcd4be 00:27:52.721 [2024-04-24 15:28:56.533158] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.721 [2024-04-24 15:28:56.533164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:27:52.721 [2024-04-24 15:28:56.533173] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0xabdcd4be 00:27:52.721 [2024-04-24 15:28:56.533180] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.721 [2024-04-24 15:28:56.533185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:27:52.721 [2024-04-24 15:28:56.533193] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0xabdcd4be 00:27:52.721 [2024-04-24 15:28:56.533199] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.721 [2024-04-24 15:28:56.533204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:27:52.721 [2024-04-24 15:28:56.533216] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0xabdcd4be 00:27:52.721 ===================================================== 00:27:52.721 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:27:52.721 ===================================================== 00:27:52.721 Controller Capabilities/Features 00:27:52.721 ================================ 00:27:52.721 Vendor ID: 8086 00:27:52.721 Subsystem Vendor ID: 8086 00:27:52.721 Serial Number: SPDK00000000000001 00:27:52.721 Model Number: SPDK bdev Controller 00:27:52.721 Firmware Version: 24.05 00:27:52.721 Recommended Arb Burst: 6 00:27:52.721 IEEE OUI Identifier: e4 d2 5c 00:27:52.721 Multi-path I/O 00:27:52.721 May have multiple subsystem ports: Yes 00:27:52.721 May have multiple controllers: Yes 00:27:52.721 Associated with SR-IOV VF: No 00:27:52.721 Max Data Transfer Size: 131072 00:27:52.721 Max Number of Namespaces: 32 00:27:52.721 Max Number of I/O Queues: 127 00:27:52.721 NVMe Specification Version (VS): 1.3 00:27:52.721 NVMe Specification Version (Identify): 1.3 00:27:52.721 Maximum Queue Entries: 128 00:27:52.721 Contiguous Queues Required: Yes 00:27:52.721 Arbitration Mechanisms Supported 00:27:52.721 Weighted Round Robin: Not Supported 00:27:52.721 Vendor Specific: Not Supported 00:27:52.721 Reset Timeout: 15000 ms 00:27:52.721 Doorbell Stride: 4 bytes 00:27:52.721 NVM Subsystem Reset: Not Supported 00:27:52.721 Command Sets Supported 00:27:52.721 NVM Command Set: Supported 00:27:52.721 Boot Partition: Not Supported 00:27:52.721 Memory Page Size Minimum: 4096 bytes 00:27:52.721 Memory Page Size Maximum: 4096 bytes 00:27:52.721 Persistent Memory Region: Not Supported 00:27:52.721 Optional Asynchronous Events Supported 00:27:52.721 Namespace Attribute Notices: Supported 00:27:52.721 Firmware Activation Notices: Not Supported 00:27:52.721 ANA Change Notices: Not Supported 00:27:52.721 PLE Aggregate Log Change Notices: Not Supported 00:27:52.721 LBA Status Info Alert Notices: Not Supported 00:27:52.721 EGE Aggregate Log Change Notices: Not Supported 00:27:52.721 Normal NVM Subsystem Shutdown event: Not Supported 00:27:52.721 Zone Descriptor Change Notices: Not Supported 00:27:52.721 Discovery Log Change Notices: Not Supported 00:27:52.721 Controller Attributes 00:27:52.721 128-bit Host Identifier: Supported 00:27:52.721 Non-Operational Permissive Mode: Not Supported 00:27:52.721 NVM Sets: Not Supported 00:27:52.721 Read Recovery Levels: Not Supported 00:27:52.721 Endurance Groups: Not Supported 00:27:52.721 Predictable Latency Mode: Not Supported 00:27:52.721 Traffic Based Keep ALive: Not Supported 00:27:52.721 Namespace Granularity: Not Supported 00:27:52.721 SQ Associations: Not Supported 00:27:52.721 UUID List: Not Supported 00:27:52.721 Multi-Domain Subsystem: Not Supported 00:27:52.721 Fixed Capacity Management: Not Supported 00:27:52.721 Variable Capacity Management: Not Supported 00:27:52.721 Delete Endurance Group: Not Supported 00:27:52.721 Delete NVM Set: Not Supported 00:27:52.721 Extended LBA Formats Supported: Not Supported 00:27:52.721 Flexible Data Placement Supported: Not Supported 00:27:52.721 00:27:52.721 Controller Memory Buffer Support 00:27:52.721 ================================ 00:27:52.721 Supported: No 00:27:52.721 00:27:52.721 Persistent Memory Region Support 00:27:52.721 ================================ 00:27:52.721 Supported: No 00:27:52.721 00:27:52.721 Admin Command Set Attributes 00:27:52.721 ============================ 00:27:52.721 Security Send/Receive: Not Supported 00:27:52.721 Format NVM: Not Supported 00:27:52.721 Firmware Activate/Download: Not Supported 00:27:52.721 Namespace Management: Not Supported 00:27:52.721 Device Self-Test: Not Supported 00:27:52.721 Directives: Not Supported 00:27:52.721 NVMe-MI: Not Supported 00:27:52.721 Virtualization Management: Not Supported 00:27:52.721 Doorbell Buffer Config: Not Supported 00:27:52.721 Get LBA Status Capability: Not Supported 00:27:52.721 Command & Feature Lockdown Capability: Not Supported 00:27:52.721 Abort Command Limit: 4 00:27:52.721 Async Event Request Limit: 4 00:27:52.721 Number of Firmware Slots: N/A 00:27:52.721 Firmware Slot 1 Read-Only: N/A 00:27:52.721 Firmware Activation Without Reset: N/A 00:27:52.721 Multiple Update Detection Support: N/A 00:27:52.721 Firmware Update Granularity: No Information Provided 00:27:52.721 Per-Namespace SMART Log: No 00:27:52.721 Asymmetric Namespace Access Log Page: Not Supported 00:27:52.721 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:27:52.721 Command Effects Log Page: Supported 00:27:52.721 Get Log Page Extended Data: Supported 00:27:52.721 Telemetry Log Pages: Not Supported 00:27:52.721 Persistent Event Log Pages: Not Supported 00:27:52.721 Supported Log Pages Log Page: May Support 00:27:52.721 Commands Supported & Effects Log Page: Not Supported 00:27:52.721 Feature Identifiers & Effects Log Page:May Support 00:27:52.721 NVMe-MI Commands & Effects Log Page: May Support 00:27:52.721 Data Area 4 for Telemetry Log: Not Supported 00:27:52.721 Error Log Page Entries Supported: 128 00:27:52.721 Keep Alive: Supported 00:27:52.721 Keep Alive Granularity: 10000 ms 00:27:52.721 00:27:52.721 NVM Command Set Attributes 00:27:52.721 ========================== 00:27:52.721 Submission Queue Entry Size 00:27:52.721 Max: 64 00:27:52.721 Min: 64 00:27:52.721 Completion Queue Entry Size 00:27:52.721 Max: 16 00:27:52.721 Min: 16 00:27:52.721 Number of Namespaces: 32 00:27:52.721 Compare Command: Supported 00:27:52.721 Write Uncorrectable Command: Not Supported 00:27:52.721 Dataset Management Command: Supported 00:27:52.721 Write Zeroes Command: Supported 00:27:52.721 Set Features Save Field: Not Supported 00:27:52.721 Reservations: Supported 00:27:52.721 Timestamp: Not Supported 00:27:52.721 Copy: Supported 00:27:52.721 Volatile Write Cache: Present 00:27:52.721 Atomic Write Unit (Normal): 1 00:27:52.721 Atomic Write Unit (PFail): 1 00:27:52.721 Atomic Compare & Write Unit: 1 00:27:52.721 Fused Compare & Write: Supported 00:27:52.721 Scatter-Gather List 00:27:52.721 SGL Command Set: Supported 00:27:52.721 SGL Keyed: Supported 00:27:52.721 SGL Bit Bucket Descriptor: Not Supported 00:27:52.721 SGL Metadata Pointer: Not Supported 00:27:52.721 Oversized SGL: Not Supported 00:27:52.722 SGL Metadata Address: Not Supported 00:27:52.722 SGL Offset: Supported 00:27:52.722 Transport SGL Data Block: Not Supported 00:27:52.722 Replay Protected Memory Block: Not Supported 00:27:52.722 00:27:52.722 Firmware Slot Information 00:27:52.722 ========================= 00:27:52.722 Active slot: 1 00:27:52.722 Slot 1 Firmware Revision: 24.05 00:27:52.722 00:27:52.722 00:27:52.722 Commands Supported and Effects 00:27:52.722 ============================== 00:27:52.722 Admin Commands 00:27:52.722 -------------- 00:27:52.722 Get Log Page (02h): Supported 00:27:52.722 Identify (06h): Supported 00:27:52.722 Abort (08h): Supported 00:27:52.722 Set Features (09h): Supported 00:27:52.722 Get Features (0Ah): Supported 00:27:52.722 Asynchronous Event Request (0Ch): Supported 00:27:52.722 Keep Alive (18h): Supported 00:27:52.722 I/O Commands 00:27:52.722 ------------ 00:27:52.722 Flush (00h): Supported LBA-Change 00:27:52.722 Write (01h): Supported LBA-Change 00:27:52.722 Read (02h): Supported 00:27:52.722 Compare (05h): Supported 00:27:52.722 Write Zeroes (08h): Supported LBA-Change 00:27:52.722 Dataset Management (09h): Supported LBA-Change 00:27:52.722 Copy (19h): Supported LBA-Change 00:27:52.722 Unknown (79h): Supported LBA-Change 00:27:52.722 Unknown (7Ah): Supported 00:27:52.722 00:27:52.722 Error Log 00:27:52.722 ========= 00:27:52.722 00:27:52.722 Arbitration 00:27:52.722 =========== 00:27:52.722 Arbitration Burst: 1 00:27:52.722 00:27:52.722 Power Management 00:27:52.722 ================ 00:27:52.722 Number of Power States: 1 00:27:52.722 Current Power State: Power State #0 00:27:52.722 Power State #0: 00:27:52.722 Max Power: 0.00 W 00:27:52.722 Non-Operational State: Operational 00:27:52.722 Entry Latency: Not Reported 00:27:52.722 Exit Latency: Not Reported 00:27:52.722 Relative Read Throughput: 0 00:27:52.722 Relative Read Latency: 0 00:27:52.722 Relative Write Throughput: 0 00:27:52.722 Relative Write Latency: 0 00:27:52.722 Idle Power: Not Reported 00:27:52.722 Active Power: Not Reported 00:27:52.722 Non-Operational Permissive Mode: Not Supported 00:27:52.722 00:27:52.722 Health Information 00:27:52.722 ================== 00:27:52.722 Critical Warnings: 00:27:52.722 Available Spare Space: OK 00:27:52.722 Temperature: OK 00:27:52.722 Device Reliability: OK 00:27:52.722 Read Only: No 00:27:52.722 Volatile Memory Backup: OK 00:27:52.722 Current Temperature: 0 Kelvin (-273 Celsius) 00:27:52.722 Temperature Threshold: [2024-04-24 15:28:56.533300] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533310] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533333] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533345] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533369] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:27:52.722 [2024-04-24 15:28:56.533378] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 53535 doesn't match qid 00:27:52.722 [2024-04-24 15:28:56.533393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32693 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533400] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 53535 doesn't match qid 00:27:52.722 [2024-04-24 15:28:56.533408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32693 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533415] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 53535 doesn't match qid 00:27:52.722 [2024-04-24 15:28:56.533423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32693 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533430] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 53535 doesn't match qid 00:27:52.722 [2024-04-24 15:28:56.533438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32693 cdw0:5 sqhd:8790 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533447] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533455] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533480] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533501] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533509] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533516] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533546] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533559] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:27:52.722 [2024-04-24 15:28:56.533566] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:27:52.722 [2024-04-24 15:28:56.533573] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533582] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533590] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533614] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533628] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533638] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533647] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533669] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533682] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533691] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533699] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533730] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533743] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533752] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533760] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533790] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533803] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533813] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533821] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533847] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533860] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533871] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533880] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533902] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533915] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533924] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.722 [2024-04-24 15:28:56.533959] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.722 [2024-04-24 15:28:56.533965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:27:52.722 [2024-04-24 15:28:56.533974] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0xabdcd4be 00:27:52.722 [2024-04-24 15:28:56.533983] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.533992] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534013] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534026] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534035] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534043] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534066] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534078] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534087] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534095] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534120] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534132] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534141] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534149] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534187] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534196] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534232] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534245] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534254] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534262] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534284] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534299] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534308] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534339] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534352] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534361] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534369] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534396] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534408] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534417] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534425] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534450] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534462] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534471] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534504] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534516] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534525] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534533] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534560] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534572] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534581] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534589] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534616] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534630] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534640] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534648] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534670] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534683] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534692] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534700] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534726] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534741] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534749] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534758] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534780] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534793] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534803] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534841] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534854] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534863] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534871] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534893] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534907] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534916] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534924] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.723 [2024-04-24 15:28:56.534949] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.723 [2024-04-24 15:28:56.534956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:27:52.723 [2024-04-24 15:28:56.534963] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0xabdcd4be 00:27:52.723 [2024-04-24 15:28:56.534972] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.534980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535003] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535015] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535024] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535054] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535066] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535075] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535083] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535104] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535116] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535125] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535133] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535160] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535172] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535182] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535219] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535231] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535240] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535250] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535271] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535283] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535292] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535300] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535327] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535339] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535348] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535356] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535381] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535393] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535402] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535410] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.535437] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.535442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.535449] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535458] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.535465] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.539493] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.539502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.539509] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.539518] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.539526] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:27:52.724 [2024-04-24 15:28:56.539550] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:27:52.724 [2024-04-24 15:28:56.539555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:001e p:0 m:0 dnr:0 00:27:52.724 [2024-04-24 15:28:56.539562] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0xabdcd4be 00:27:52.724 [2024-04-24 15:28:56.539571] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:27:52.724 0 Kelvin (-273 Celsius) 00:27:52.724 Available Spare: 0% 00:27:52.724 Available Spare Threshold: 0% 00:27:52.724 Life Percentage Used: 0% 00:27:52.724 Data Units Read: 0 00:27:52.724 Data Units Written: 0 00:27:52.724 Host Read Commands: 0 00:27:52.724 Host Write Commands: 0 00:27:52.724 Controller Busy Time: 0 minutes 00:27:52.724 Power Cycles: 0 00:27:52.724 Power On Hours: 0 hours 00:27:52.724 Unsafe Shutdowns: 0 00:27:52.724 Unrecoverable Media Errors: 0 00:27:52.724 Lifetime Error Log Entries: 0 00:27:52.724 Warning Temperature Time: 0 minutes 00:27:52.724 Critical Temperature Time: 0 minutes 00:27:52.724 00:27:52.724 Number of Queues 00:27:52.724 ================ 00:27:52.724 Number of I/O Submission Queues: 127 00:27:52.724 Number of I/O Completion Queues: 127 00:27:52.724 00:27:52.724 Active Namespaces 00:27:52.724 ================= 00:27:52.724 Namespace ID:1 00:27:52.724 Error Recovery Timeout: Unlimited 00:27:52.724 Command Set Identifier: NVM (00h) 00:27:52.724 Deallocate: Supported 00:27:52.724 Deallocated/Unwritten Error: Not Supported 00:27:52.724 Deallocated Read Value: Unknown 00:27:52.724 Deallocate in Write Zeroes: Not Supported 00:27:52.724 Deallocated Guard Field: 0xFFFF 00:27:52.724 Flush: Supported 00:27:52.724 Reservation: Supported 00:27:52.724 Namespace Sharing Capabilities: Multiple Controllers 00:27:52.724 Size (in LBAs): 131072 (0GiB) 00:27:52.724 Capacity (in LBAs): 131072 (0GiB) 00:27:52.724 Utilization (in LBAs): 131072 (0GiB) 00:27:52.724 NGUID: ABCDEF0123456789ABCDEF0123456789 00:27:52.724 EUI64: ABCDEF0123456789 00:27:52.724 UUID: b4af71f3-b19c-4fbd-833f-2f3892d7898c 00:27:52.724 Thin Provisioning: Not Supported 00:27:52.724 Per-NS Atomic Units: Yes 00:27:52.724 Atomic Boundary Size (Normal): 0 00:27:52.724 Atomic Boundary Size (PFail): 0 00:27:52.724 Atomic Boundary Offset: 0 00:27:52.724 Maximum Single Source Range Length: 65535 00:27:52.724 Maximum Copy Length: 65535 00:27:52.724 Maximum Source Range Count: 1 00:27:52.724 NGUID/EUI64 Never Reused: No 00:27:52.724 Namespace Write Protected: No 00:27:52.724 Number of LBA Formats: 1 00:27:52.724 Current LBA Format: LBA Format #00 00:27:52.724 LBA Format #00: Data Size: 512 Metadata Size: 0 00:27:52.724 00:27:52.724 15:28:56 -- host/identify.sh@51 -- # sync 00:27:52.724 15:28:56 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:52.724 15:28:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:52.724 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:52.724 15:28:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:52.724 15:28:56 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:27:52.724 15:28:56 -- host/identify.sh@56 -- # nvmftestfini 00:27:52.724 15:28:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:52.724 15:28:56 -- nvmf/common.sh@117 -- # sync 00:27:52.724 15:28:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:52.724 15:28:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:52.724 15:28:56 -- nvmf/common.sh@120 -- # set +e 00:27:52.724 15:28:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:52.724 15:28:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:52.724 rmmod nvme_rdma 00:27:52.986 rmmod nvme_fabrics 00:27:52.986 15:28:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:52.986 15:28:56 -- nvmf/common.sh@124 -- # set -e 00:27:52.986 15:28:56 -- nvmf/common.sh@125 -- # return 0 00:27:52.986 15:28:56 -- nvmf/common.sh@478 -- # '[' -n 756926 ']' 00:27:52.986 15:28:56 -- nvmf/common.sh@479 -- # killprocess 756926 00:27:52.986 15:28:56 -- common/autotest_common.sh@936 -- # '[' -z 756926 ']' 00:27:52.986 15:28:56 -- common/autotest_common.sh@940 -- # kill -0 756926 00:27:52.986 15:28:56 -- common/autotest_common.sh@941 -- # uname 00:27:52.986 15:28:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:52.986 15:28:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 756926 00:27:52.986 15:28:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:52.986 15:28:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:52.986 15:28:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 756926' 00:27:52.986 killing process with pid 756926 00:27:52.986 15:28:56 -- common/autotest_common.sh@955 -- # kill 756926 00:27:52.986 [2024-04-24 15:28:56.703957] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:52.986 15:28:56 -- common/autotest_common.sh@960 -- # wait 756926 00:27:52.986 [2024-04-24 15:28:56.737852] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:53.280 15:28:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:53.280 15:28:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:53.280 00:27:53.280 real 0m8.994s 00:27:53.280 user 0m7.961s 00:27:53.280 sys 0m5.900s 00:27:53.280 15:28:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:53.280 15:28:56 -- common/autotest_common.sh@10 -- # set +x 00:27:53.280 ************************************ 00:27:53.280 END TEST nvmf_identify 00:27:53.280 ************************************ 00:27:53.280 15:28:57 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:27:53.280 15:28:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:53.280 15:28:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:53.280 15:28:57 -- common/autotest_common.sh@10 -- # set +x 00:27:53.280 ************************************ 00:27:53.280 START TEST nvmf_perf 00:27:53.280 ************************************ 00:27:53.280 15:28:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:27:53.561 * Looking for test storage... 00:27:53.561 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:27:53.561 15:28:57 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:27:53.561 15:28:57 -- nvmf/common.sh@7 -- # uname -s 00:27:53.561 15:28:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:53.561 15:28:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:53.561 15:28:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:53.561 15:28:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:53.561 15:28:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:53.561 15:28:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:53.561 15:28:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:53.561 15:28:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:53.561 15:28:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:53.561 15:28:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:53.561 15:28:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:27:53.561 15:28:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:27:53.561 15:28:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:53.561 15:28:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:53.561 15:28:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:53.561 15:28:57 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:53.561 15:28:57 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:27:53.561 15:28:57 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:53.561 15:28:57 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:53.561 15:28:57 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:53.561 15:28:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.561 15:28:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.561 15:28:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.561 15:28:57 -- paths/export.sh@5 -- # export PATH 00:27:53.561 15:28:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:53.561 15:28:57 -- nvmf/common.sh@47 -- # : 0 00:27:53.561 15:28:57 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:53.561 15:28:57 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:53.561 15:28:57 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:53.561 15:28:57 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:53.561 15:28:57 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:53.561 15:28:57 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:53.561 15:28:57 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:53.561 15:28:57 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:53.561 15:28:57 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:27:53.561 15:28:57 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:27:53.561 15:28:57 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:27:53.561 15:28:57 -- host/perf.sh@17 -- # nvmftestinit 00:27:53.561 15:28:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:53.561 15:28:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:53.561 15:28:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:53.561 15:28:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:53.561 15:28:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:53.561 15:28:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.561 15:28:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.561 15:28:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:53.561 15:28:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:53.561 15:28:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:53.561 15:28:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:53.561 15:28:57 -- common/autotest_common.sh@10 -- # set +x 00:28:01.766 15:29:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:01.766 15:29:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:01.766 15:29:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:01.766 15:29:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:01.766 15:29:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:01.766 15:29:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:01.766 15:29:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:01.766 15:29:04 -- nvmf/common.sh@295 -- # net_devs=() 00:28:01.766 15:29:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:01.767 15:29:04 -- nvmf/common.sh@296 -- # e810=() 00:28:01.767 15:29:04 -- nvmf/common.sh@296 -- # local -ga e810 00:28:01.767 15:29:04 -- nvmf/common.sh@297 -- # x722=() 00:28:01.767 15:29:04 -- nvmf/common.sh@297 -- # local -ga x722 00:28:01.767 15:29:04 -- nvmf/common.sh@298 -- # mlx=() 00:28:01.767 15:29:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:01.767 15:29:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:01.767 15:29:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:28:01.767 Found 0000:18:00.0 (0x8086 - 0x1592) 00:28:01.767 15:29:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:01.767 15:29:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:28:01.767 Found 0000:18:00.1 (0x8086 - 0x1592) 00:28:01.767 15:29:04 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:01.767 15:29:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@377 -- # modinfo irdma 00:28:01.767 15:29:04 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:28:01.767 15:29:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:01.767 15:29:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:01.767 15:29:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:28:01.767 Found net devices under 0000:18:00.0: cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:01.767 15:29:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:01.767 15:29:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:28:01.767 Found net devices under 0000:18:00.1: cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:01.767 15:29:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:01.767 15:29:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:28:01.767 15:29:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:28:01.767 15:29:04 -- nvmf/common.sh@58 -- # uname 00:28:01.767 15:29:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:28:01.767 15:29:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:28:01.767 15:29:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:28:01.767 15:29:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:28:01.767 15:29:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:28:01.767 15:29:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:28:01.767 15:29:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:28:01.767 15:29:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:28:01.767 15:29:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:28:01.767 15:29:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:28:01.767 15:29:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:28:01.767 15:29:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:01.767 15:29:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:01.767 15:29:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:01.767 15:29:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:01.767 15:29:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@105 -- # continue 2 00:28:01.767 15:29:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@105 -- # continue 2 00:28:01.767 15:29:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:01.767 15:29:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:01.767 15:29:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:28:01.767 15:29:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:28:01.767 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:01.767 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:28:01.767 altname enp24s0f0np0 00:28:01.767 altname ens785f0np0 00:28:01.767 inet 192.168.100.8/24 scope global cvl_0_0 00:28:01.767 valid_lft forever preferred_lft forever 00:28:01.767 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:28:01.767 valid_lft forever preferred_lft forever 00:28:01.767 15:29:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:01.767 15:29:04 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:01.767 15:29:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:01.767 15:29:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:28:01.767 15:29:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:28:01.767 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:28:01.767 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:28:01.767 altname enp24s0f1np1 00:28:01.767 altname ens785f1np1 00:28:01.767 inet 192.168.100.9/24 scope global cvl_0_1 00:28:01.767 valid_lft forever preferred_lft forever 00:28:01.767 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:28:01.767 valid_lft forever preferred_lft forever 00:28:01.767 15:29:04 -- nvmf/common.sh@411 -- # return 0 00:28:01.767 15:29:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:01.767 15:29:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:28:01.767 15:29:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:28:01.767 15:29:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:28:01.767 15:29:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:01.767 15:29:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:01.767 15:29:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:01.767 15:29:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:01.767 15:29:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:01.767 15:29:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:28:01.767 15:29:04 -- nvmf/common.sh@105 -- # continue 2 00:28:01.767 15:29:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:01.767 15:29:04 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:28:01.767 15:29:04 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:28:01.767 15:29:04 -- nvmf/common.sh@105 -- # continue 2 00:28:01.768 15:29:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:01.768 15:29:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:28:01.768 15:29:04 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:01.768 15:29:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:01.768 15:29:04 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:28:01.768 15:29:04 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:01.768 15:29:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:01.768 15:29:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:28:01.768 192.168.100.9' 00:28:01.768 15:29:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:28:01.768 192.168.100.9' 00:28:01.768 15:29:04 -- nvmf/common.sh@446 -- # head -n 1 00:28:01.768 15:29:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:28:01.768 15:29:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:28:01.768 192.168.100.9' 00:28:01.768 15:29:04 -- nvmf/common.sh@447 -- # tail -n +2 00:28:01.768 15:29:04 -- nvmf/common.sh@447 -- # head -n 1 00:28:01.768 15:29:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:28:01.768 15:29:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:28:01.768 15:29:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:28:01.768 15:29:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:28:01.768 15:29:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:28:01.768 15:29:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:28:01.768 15:29:04 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:28:01.768 15:29:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:28:01.768 15:29:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:01.768 15:29:04 -- common/autotest_common.sh@10 -- # set +x 00:28:01.768 15:29:04 -- nvmf/common.sh@470 -- # nvmfpid=760500 00:28:01.768 15:29:04 -- nvmf/common.sh@471 -- # waitforlisten 760500 00:28:01.768 15:29:04 -- common/autotest_common.sh@817 -- # '[' -z 760500 ']' 00:28:01.768 15:29:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:01.768 15:29:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:01.768 15:29:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:01.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:01.768 15:29:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:01.768 15:29:04 -- common/autotest_common.sh@10 -- # set +x 00:28:01.768 15:29:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:01.768 [2024-04-24 15:29:04.785162] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:28:01.768 [2024-04-24 15:29:04.785213] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:01.768 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.768 [2024-04-24 15:29:04.864940] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:01.768 [2024-04-24 15:29:04.947178] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:01.768 [2024-04-24 15:29:04.947220] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:01.768 [2024-04-24 15:29:04.947230] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:28:01.768 [2024-04-24 15:29:04.947242] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:28:01.768 [2024-04-24 15:29:04.947249] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:01.768 [2024-04-24 15:29:04.947309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:01.768 [2024-04-24 15:29:04.947370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:01.768 [2024-04-24 15:29:04.947444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:01.768 [2024-04-24 15:29:04.947446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:01.768 15:29:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:01.768 15:29:05 -- common/autotest_common.sh@850 -- # return 0 00:28:01.768 15:29:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:28:01.768 15:29:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:01.768 15:29:05 -- common/autotest_common.sh@10 -- # set +x 00:28:01.768 15:29:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:01.768 15:29:05 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:28:01.768 15:29:05 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:05.058 15:29:08 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:28:05.058 15:29:08 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:28:05.058 15:29:08 -- host/perf.sh@30 -- # local_nvme_trid=0000:5e:00.0 00:28:05.058 15:29:08 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:28:05.317 15:29:09 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:28:05.317 15:29:09 -- host/perf.sh@33 -- # '[' -n 0000:5e:00.0 ']' 00:28:05.317 15:29:09 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:28:05.317 15:29:09 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:28:05.318 15:29:09 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:28:05.318 [2024-04-24 15:29:09.198556] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:28:05.318 [2024-04-24 15:29:09.213867] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1713b70/0x17131b0) succeed. 00:28:05.318 [2024-04-24 15:29:09.224621] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1714f20/0x1713730) succeed. 00:28:05.318 [2024-04-24 15:29:09.224644] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:28:05.577 15:29:09 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:05.577 15:29:09 -- host/perf.sh@45 -- # for bdev in $bdevs 00:28:05.577 15:29:09 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:05.836 15:29:09 -- host/perf.sh@45 -- # for bdev in $bdevs 00:28:05.836 15:29:09 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:06.095 15:29:09 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:06.095 [2024-04-24 15:29:09.975602] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:28:06.095 15:29:10 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:28:06.365 15:29:10 -- host/perf.sh@52 -- # '[' -n 0000:5e:00.0 ']' 00:28:06.365 15:29:10 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:28:06.365 15:29:10 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:28:06.365 15:29:10 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:28:07.743 Initializing NVMe Controllers 00:28:07.743 Attached to NVMe Controller at 0000:5e:00.0 [8086:0a54] 00:28:07.743 Associating PCIE (0000:5e:00.0) NSID 1 with lcore 0 00:28:07.743 Initialization complete. Launching workers. 00:28:07.743 ======================================================== 00:28:07.743 Latency(us) 00:28:07.743 Device Information : IOPS MiB/s Average min max 00:28:07.743 PCIE (0000:5e:00.0) NSID 1 from core 0: 99977.49 390.54 319.72 26.27 4821.49 00:28:07.743 ======================================================== 00:28:07.743 Total : 99977.49 390.54 319.72 26.27 4821.49 00:28:07.743 00:28:07.743 15:29:11 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:07.743 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.034 Initializing NVMe Controllers 00:28:11.034 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:11.034 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:11.034 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:11.034 Initialization complete. Launching workers. 00:28:11.034 ======================================================== 00:28:11.034 Latency(us) 00:28:11.034 Device Information : IOPS MiB/s Average min max 00:28:11.034 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6315.99 24.67 158.11 55.63 4086.91 00:28:11.034 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5022.99 19.62 198.87 77.36 4119.64 00:28:11.034 ======================================================== 00:28:11.034 Total : 11338.99 44.29 176.16 55.63 4119.64 00:28:11.034 00:28:11.034 15:29:14 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:11.034 EAL: No free 2048 kB hugepages reported on node 1 00:28:14.327 Initializing NVMe Controllers 00:28:14.327 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:14.327 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:14.327 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:14.327 Initialization complete. Launching workers. 00:28:14.327 ======================================================== 00:28:14.327 Latency(us) 00:28:14.327 Device Information : IOPS MiB/s Average min max 00:28:14.327 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18567.98 72.53 1723.32 473.07 5507.08 00:28:14.327 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4032.00 15.75 7979.07 7559.86 8258.28 00:28:14.327 ======================================================== 00:28:14.327 Total : 22599.98 88.28 2839.39 473.07 8258.28 00:28:14.327 00:28:14.327 15:29:18 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:28:14.327 15:29:18 -- host/perf.sh@59 -- # [[ rdma == \r\d\m\a ]] 00:28:14.327 15:29:18 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:28:14.586 EAL: No free 2048 kB hugepages reported on node 1 00:28:14.586 No valid NVMe controllers or AIO or URING devices found 00:28:14.587 Initializing NVMe Controllers 00:28:14.587 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:14.587 Controller IO queue size 128, less than required. 00:28:14.587 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:14.587 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:28:14.587 Controller IO queue size 128, less than required. 00:28:14.587 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:14.587 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:28:14.587 WARNING: Some requested NVMe devices were skipped 00:28:14.587 15:29:18 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:28:14.587 EAL: No free 2048 kB hugepages reported on node 1 00:28:19.863 Initializing NVMe Controllers 00:28:19.863 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:19.863 Controller IO queue size 128, less than required. 00:28:19.863 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:19.863 Controller IO queue size 128, less than required. 00:28:19.863 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:19.863 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:19.863 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:19.863 Initialization complete. Launching workers. 00:28:19.863 00:28:19.863 ==================== 00:28:19.863 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:28:19.863 RDMA transport: 00:28:19.863 dev name: rocep24s0f0 00:28:19.863 polls: 357442 00:28:19.863 idle_polls: 351990 00:28:19.863 completions: 45326 00:28:19.863 queued_requests: 1 00:28:19.863 total_send_wrs: 22663 00:28:19.863 send_doorbell_updates: 4878 00:28:19.863 total_recv_wrs: 22790 00:28:19.863 recv_doorbell_updates: 4880 00:28:19.863 --------------------------------- 00:28:19.863 00:28:19.863 ==================== 00:28:19.863 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:28:19.863 RDMA transport: 00:28:19.863 dev name: rocep24s0f0 00:28:19.863 polls: 359411 00:28:19.863 idle_polls: 351216 00:28:19.863 completions: 52422 00:28:19.863 queued_requests: 1 00:28:19.863 total_send_wrs: 26211 00:28:19.863 send_doorbell_updates: 7154 00:28:19.863 total_recv_wrs: 26338 00:28:19.863 recv_doorbell_updates: 7155 00:28:19.863 --------------------------------- 00:28:19.863 ======================================================== 00:28:19.863 Latency(us) 00:28:19.863 Device Information : IOPS MiB/s Average min max 00:28:19.863 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5665.50 1416.38 22762.81 15939.63 55983.29 00:28:19.863 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 6552.50 1638.12 19391.30 14825.33 39395.91 00:28:19.863 ======================================================== 00:28:19.863 Total : 12218.00 3054.50 20954.67 14825.33 55983.29 00:28:19.863 00:28:19.863 15:29:22 -- host/perf.sh@66 -- # sync 00:28:19.863 15:29:22 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:19.863 15:29:23 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:28:19.863 15:29:23 -- host/perf.sh@71 -- # '[' -n 0000:5e:00.0 ']' 00:28:19.863 15:29:23 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:28:32.074 15:29:35 -- host/perf.sh@72 -- # ls_guid=e23686e4-0130-4676-9a24-ccb79b2d79f6 00:28:32.074 15:29:35 -- host/perf.sh@73 -- # get_lvs_free_mb e23686e4-0130-4676-9a24-ccb79b2d79f6 00:28:32.074 15:29:35 -- common/autotest_common.sh@1350 -- # local lvs_uuid=e23686e4-0130-4676-9a24-ccb79b2d79f6 00:28:32.074 15:29:35 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:32.074 15:29:35 -- common/autotest_common.sh@1352 -- # local fc 00:28:32.074 15:29:35 -- common/autotest_common.sh@1353 -- # local cs 00:28:32.074 15:29:35 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:32.074 15:29:35 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:32.074 { 00:28:32.074 "uuid": "e23686e4-0130-4676-9a24-ccb79b2d79f6", 00:28:32.074 "name": "lvs_0", 00:28:32.074 "base_bdev": "Nvme0n1", 00:28:32.074 "total_data_clusters": 952929, 00:28:32.074 "free_clusters": 952929, 00:28:32.074 "block_size": 512, 00:28:32.074 "cluster_size": 4194304 00:28:32.074 } 00:28:32.074 ]' 00:28:32.074 15:29:35 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="e23686e4-0130-4676-9a24-ccb79b2d79f6") .free_clusters' 00:28:32.074 15:29:35 -- common/autotest_common.sh@1355 -- # fc=952929 00:28:32.075 15:29:35 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="e23686e4-0130-4676-9a24-ccb79b2d79f6") .cluster_size' 00:28:32.075 15:29:35 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:32.075 15:29:35 -- common/autotest_common.sh@1359 -- # free_mb=3811716 00:28:32.075 15:29:35 -- common/autotest_common.sh@1360 -- # echo 3811716 00:28:32.075 3811716 00:28:32.075 15:29:35 -- host/perf.sh@77 -- # '[' 3811716 -gt 20480 ']' 00:28:32.075 15:29:35 -- host/perf.sh@78 -- # free_mb=20480 00:28:32.075 15:29:35 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e23686e4-0130-4676-9a24-ccb79b2d79f6 lbd_0 20480 00:28:33.450 15:29:36 -- host/perf.sh@80 -- # lb_guid=58d3fd50-7425-4ddc-99d4-cd25d619dc2c 00:28:33.450 15:29:36 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 58d3fd50-7425-4ddc-99d4-cd25d619dc2c lvs_n_0 00:28:34.827 15:29:38 -- host/perf.sh@83 -- # ls_nested_guid=1f8c5613-f5a0-4764-ba29-0171d40ecb29 00:28:34.827 15:29:38 -- host/perf.sh@84 -- # get_lvs_free_mb 1f8c5613-f5a0-4764-ba29-0171d40ecb29 00:28:34.827 15:29:38 -- common/autotest_common.sh@1350 -- # local lvs_uuid=1f8c5613-f5a0-4764-ba29-0171d40ecb29 00:28:34.827 15:29:38 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:34.827 15:29:38 -- common/autotest_common.sh@1352 -- # local fc 00:28:34.827 15:29:38 -- common/autotest_common.sh@1353 -- # local cs 00:28:34.827 15:29:38 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:34.827 15:29:38 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:34.827 { 00:28:34.827 "uuid": "e23686e4-0130-4676-9a24-ccb79b2d79f6", 00:28:34.827 "name": "lvs_0", 00:28:34.827 "base_bdev": "Nvme0n1", 00:28:34.827 "total_data_clusters": 952929, 00:28:34.827 "free_clusters": 947809, 00:28:34.827 "block_size": 512, 00:28:34.827 "cluster_size": 4194304 00:28:34.827 }, 00:28:34.827 { 00:28:34.828 "uuid": "1f8c5613-f5a0-4764-ba29-0171d40ecb29", 00:28:34.828 "name": "lvs_n_0", 00:28:34.828 "base_bdev": "58d3fd50-7425-4ddc-99d4-cd25d619dc2c", 00:28:34.828 "total_data_clusters": 5114, 00:28:34.828 "free_clusters": 5114, 00:28:34.828 "block_size": 512, 00:28:34.828 "cluster_size": 4194304 00:28:34.828 } 00:28:34.828 ]' 00:28:34.828 15:29:38 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="1f8c5613-f5a0-4764-ba29-0171d40ecb29") .free_clusters' 00:28:34.828 15:29:38 -- common/autotest_common.sh@1355 -- # fc=5114 00:28:34.828 15:29:38 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="1f8c5613-f5a0-4764-ba29-0171d40ecb29") .cluster_size' 00:28:34.828 15:29:38 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:34.828 15:29:38 -- common/autotest_common.sh@1359 -- # free_mb=20456 00:28:34.828 15:29:38 -- common/autotest_common.sh@1360 -- # echo 20456 00:28:34.828 20456 00:28:34.828 15:29:38 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:28:34.828 15:29:38 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1f8c5613-f5a0-4764-ba29-0171d40ecb29 lbd_nest_0 20456 00:28:35.086 15:29:38 -- host/perf.sh@88 -- # lb_nested_guid=c0eafae2-15ee-456c-8f19-32fdf9842239 00:28:35.086 15:29:38 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:35.344 15:29:39 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:28:35.344 15:29:39 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 c0eafae2-15ee-456c-8f19-32fdf9842239 00:28:35.603 15:29:39 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:35.603 15:29:39 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:28:35.603 15:29:39 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:28:35.603 15:29:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:35.603 15:29:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:35.603 15:29:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:35.862 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.075 Initializing NVMe Controllers 00:28:48.075 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:48.075 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:48.075 Initialization complete. Launching workers. 00:28:48.075 ======================================================== 00:28:48.075 Latency(us) 00:28:48.075 Device Information : IOPS MiB/s Average min max 00:28:48.075 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5321.50 2.60 187.70 75.02 8090.00 00:28:48.075 ======================================================== 00:28:48.075 Total : 5321.50 2.60 187.70 75.02 8090.00 00:28:48.075 00:28:48.075 15:29:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:48.075 15:29:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:48.075 EAL: No free 2048 kB hugepages reported on node 1 00:29:00.283 Initializing NVMe Controllers 00:29:00.283 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:00.283 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:00.283 Initialization complete. Launching workers. 00:29:00.283 ======================================================== 00:29:00.283 Latency(us) 00:29:00.283 Device Information : IOPS MiB/s Average min max 00:29:00.283 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 124.90 15.61 8010.65 3988.81 15963.13 00:29:00.283 ======================================================== 00:29:00.283 Total : 124.90 15.61 8010.65 3988.81 15963.13 00:29:00.283 00:29:00.283 15:30:02 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:29:00.283 15:30:02 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:00.283 15:30:02 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:00.283 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.263 Initializing NVMe Controllers 00:29:10.263 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:10.263 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:10.263 Initialization complete. Launching workers. 00:29:10.263 ======================================================== 00:29:10.263 Latency(us) 00:29:10.263 Device Information : IOPS MiB/s Average min max 00:29:10.263 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11393.50 5.56 2808.47 777.28 7907.97 00:29:10.263 ======================================================== 00:29:10.263 Total : 11393.50 5.56 2808.47 777.28 7907.97 00:29:10.263 00:29:10.263 15:30:13 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:10.263 15:30:13 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:10.263 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.644 Initializing NVMe Controllers 00:29:22.644 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:22.644 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:22.644 Initialization complete. Launching workers. 00:29:22.644 ======================================================== 00:29:22.644 Latency(us) 00:29:22.644 Device Information : IOPS MiB/s Average min max 00:29:22.644 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8932.13 1116.52 3582.87 625.42 10676.40 00:29:22.644 ======================================================== 00:29:22.644 Total : 8932.13 1116.52 3582.87 625.42 10676.40 00:29:22.644 00:29:22.644 15:30:24 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:29:22.644 15:30:24 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:22.644 15:30:24 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:22.644 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.627 Initializing NVMe Controllers 00:29:32.627 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:32.627 Controller IO queue size 128, less than required. 00:29:32.627 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:32.627 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:32.627 Initialization complete. Launching workers. 00:29:32.627 ======================================================== 00:29:32.627 Latency(us) 00:29:32.627 Device Information : IOPS MiB/s Average min max 00:29:32.627 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18977.00 9.27 6748.06 2006.46 15813.98 00:29:32.627 ======================================================== 00:29:32.627 Total : 18977.00 9.27 6748.06 2006.46 15813.98 00:29:32.627 00:29:32.627 15:30:36 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:32.627 15:30:36 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:32.627 EAL: No free 2048 kB hugepages reported on node 1 00:29:44.842 Initializing NVMe Controllers 00:29:44.842 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:44.842 Controller IO queue size 128, less than required. 00:29:44.842 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:44.842 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:44.842 Initialization complete. Launching workers. 00:29:44.842 ======================================================== 00:29:44.842 Latency(us) 00:29:44.842 Device Information : IOPS MiB/s Average min max 00:29:44.842 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6213.00 776.62 20620.64 7865.00 35783.09 00:29:44.842 ======================================================== 00:29:44.842 Total : 6213.00 776.62 20620.64 7865.00 35783.09 00:29:44.842 00:29:44.842 15:30:47 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:44.842 15:30:47 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c0eafae2-15ee-456c-8f19-32fdf9842239 00:29:44.842 15:30:48 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:29:44.842 15:30:48 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 58d3fd50-7425-4ddc-99d4-cd25d619dc2c 00:29:45.101 15:30:48 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:29:45.360 15:30:49 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:29:45.360 15:30:49 -- host/perf.sh@114 -- # nvmftestfini 00:29:45.360 15:30:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:45.360 15:30:49 -- nvmf/common.sh@117 -- # sync 00:29:45.360 15:30:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:29:45.360 15:30:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:29:45.360 15:30:49 -- nvmf/common.sh@120 -- # set +e 00:29:45.360 15:30:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:45.360 15:30:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:29:45.360 rmmod nvme_rdma 00:29:45.360 rmmod nvme_fabrics 00:29:45.360 15:30:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:45.360 15:30:49 -- nvmf/common.sh@124 -- # set -e 00:29:45.360 15:30:49 -- nvmf/common.sh@125 -- # return 0 00:29:45.360 15:30:49 -- nvmf/common.sh@478 -- # '[' -n 760500 ']' 00:29:45.360 15:30:49 -- nvmf/common.sh@479 -- # killprocess 760500 00:29:45.360 15:30:49 -- common/autotest_common.sh@936 -- # '[' -z 760500 ']' 00:29:45.360 15:30:49 -- common/autotest_common.sh@940 -- # kill -0 760500 00:29:45.360 15:30:49 -- common/autotest_common.sh@941 -- # uname 00:29:45.360 15:30:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:45.360 15:30:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 760500 00:29:45.360 15:30:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:45.360 15:30:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:45.360 15:30:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 760500' 00:29:45.360 killing process with pid 760500 00:29:45.360 15:30:49 -- common/autotest_common.sh@955 -- # kill 760500 00:29:45.360 15:30:49 -- common/autotest_common.sh@960 -- # wait 760500 00:29:45.360 [2024-04-24 15:30:49.165768] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:29:49.561 15:30:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:29:49.561 15:30:53 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:29:49.561 00:29:49.561 real 1m55.857s 00:29:49.561 user 7m15.701s 00:29:49.561 sys 0m7.926s 00:29:49.561 15:30:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:29:49.561 15:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:49.561 ************************************ 00:29:49.561 END TEST nvmf_perf 00:29:49.561 ************************************ 00:29:49.561 15:30:53 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:29:49.561 15:30:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:49.561 15:30:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:49.561 15:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:49.561 ************************************ 00:29:49.561 START TEST nvmf_fio_host 00:29:49.561 ************************************ 00:29:49.561 15:30:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:29:49.561 * Looking for test storage... 00:29:49.561 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:29:49.561 15:30:53 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:29:49.561 15:30:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:49.561 15:30:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:49.561 15:30:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:49.561 15:30:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@5 -- # export PATH 00:29:49.561 15:30:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:29:49.561 15:30:53 -- nvmf/common.sh@7 -- # uname -s 00:29:49.561 15:30:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:49.561 15:30:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:49.561 15:30:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:49.561 15:30:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:49.561 15:30:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:49.561 15:30:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:49.561 15:30:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:49.561 15:30:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:49.561 15:30:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:49.561 15:30:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:49.561 15:30:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:29:49.561 15:30:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:29:49.561 15:30:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:49.561 15:30:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:49.561 15:30:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:49.561 15:30:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:29:49.561 15:30:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:29:49.561 15:30:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:49.561 15:30:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:49.561 15:30:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:49.561 15:30:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- paths/export.sh@5 -- # export PATH 00:29:49.561 15:30:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.561 15:30:53 -- nvmf/common.sh@47 -- # : 0 00:29:49.561 15:30:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:29:49.561 15:30:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:29:49.561 15:30:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:29:49.561 15:30:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:49.561 15:30:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:49.561 15:30:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:29:49.561 15:30:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:29:49.561 15:30:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:29:49.561 15:30:53 -- host/fio.sh@12 -- # nvmftestinit 00:29:49.561 15:30:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:29:49.561 15:30:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:49.561 15:30:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:29:49.561 15:30:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:29:49.561 15:30:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:29:49.561 15:30:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:49.561 15:30:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:49.561 15:30:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:49.561 15:30:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:29:49.561 15:30:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:29:49.561 15:30:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:29:49.561 15:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:57.691 15:31:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:57.691 15:31:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:29:57.691 15:31:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:29:57.691 15:31:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:29:57.691 15:31:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:29:57.691 15:31:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:29:57.691 15:31:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:29:57.691 15:31:00 -- nvmf/common.sh@295 -- # net_devs=() 00:29:57.691 15:31:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:29:57.691 15:31:00 -- nvmf/common.sh@296 -- # e810=() 00:29:57.691 15:31:00 -- nvmf/common.sh@296 -- # local -ga e810 00:29:57.691 15:31:00 -- nvmf/common.sh@297 -- # x722=() 00:29:57.691 15:31:00 -- nvmf/common.sh@297 -- # local -ga x722 00:29:57.691 15:31:00 -- nvmf/common.sh@298 -- # mlx=() 00:29:57.691 15:31:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:29:57.691 15:31:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:57.691 15:31:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:29:57.691 Found 0000:18:00.0 (0x8086 - 0x1592) 00:29:57.691 15:31:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:57.691 15:31:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:29:57.691 Found 0000:18:00.1 (0x8086 - 0x1592) 00:29:57.691 15:31:00 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:29:57.691 15:31:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@377 -- # modinfo irdma 00:29:57.691 15:31:00 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:29:57.691 15:31:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:57.691 15:31:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:57.691 15:31:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:29:57.691 Found net devices under 0000:18:00.0: cvl_0_0 00:29:57.691 15:31:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:57.691 15:31:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:57.691 15:31:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:29:57.691 Found net devices under 0000:18:00.1: cvl_0_1 00:29:57.691 15:31:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:29:57.691 15:31:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:29:57.691 15:31:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:29:57.691 15:31:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:29:57.691 15:31:00 -- nvmf/common.sh@58 -- # uname 00:29:57.691 15:31:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:29:57.691 15:31:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:29:57.691 15:31:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:29:57.691 15:31:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:29:57.691 15:31:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:29:57.691 15:31:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:29:57.691 15:31:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:29:57.691 15:31:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:29:57.691 15:31:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:29:57.691 15:31:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:29:57.691 15:31:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:29:57.691 15:31:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:57.691 15:31:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:57.691 15:31:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:57.691 15:31:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:57.691 15:31:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:57.691 15:31:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:57.691 15:31:00 -- nvmf/common.sh@105 -- # continue 2 00:29:57.691 15:31:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.691 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:57.691 15:31:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:57.691 15:31:00 -- nvmf/common.sh@105 -- # continue 2 00:29:57.691 15:31:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:57.691 15:31:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:29:57.691 15:31:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:57.691 15:31:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:57.691 15:31:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:57.691 15:31:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:57.692 15:31:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:29:57.692 15:31:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:29:57.692 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:57.692 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:29:57.692 altname enp24s0f0np0 00:29:57.692 altname ens785f0np0 00:29:57.692 inet 192.168.100.8/24 scope global cvl_0_0 00:29:57.692 valid_lft forever preferred_lft forever 00:29:57.692 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:29:57.692 valid_lft forever preferred_lft forever 00:29:57.692 15:31:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:29:57.692 15:31:00 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:57.692 15:31:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:29:57.692 15:31:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:29:57.692 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:29:57.692 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:29:57.692 altname enp24s0f1np1 00:29:57.692 altname ens785f1np1 00:29:57.692 inet 192.168.100.9/24 scope global cvl_0_1 00:29:57.692 valid_lft forever preferred_lft forever 00:29:57.692 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:29:57.692 valid_lft forever preferred_lft forever 00:29:57.692 15:31:00 -- nvmf/common.sh@411 -- # return 0 00:29:57.692 15:31:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:29:57.692 15:31:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:29:57.692 15:31:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:29:57.692 15:31:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:29:57.692 15:31:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:29:57.692 15:31:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:29:57.692 15:31:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:29:57.692 15:31:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:29:57.692 15:31:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:29:57.692 15:31:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:57.692 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.692 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.692 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:29:57.692 15:31:00 -- nvmf/common.sh@105 -- # continue 2 00:29:57.692 15:31:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:29:57.692 15:31:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:29:57.692 15:31:00 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:29:57.692 15:31:00 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@105 -- # continue 2 00:29:57.692 15:31:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:57.692 15:31:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:29:57.692 15:31:00 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:57.692 15:31:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:29:57.692 15:31:00 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:29:57.692 15:31:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:29:57.692 15:31:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:29:57.692 192.168.100.9' 00:29:57.692 15:31:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:29:57.692 192.168.100.9' 00:29:57.692 15:31:00 -- nvmf/common.sh@446 -- # head -n 1 00:29:57.692 15:31:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:29:57.692 15:31:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:29:57.692 192.168.100.9' 00:29:57.692 15:31:00 -- nvmf/common.sh@447 -- # head -n 1 00:29:57.692 15:31:00 -- nvmf/common.sh@447 -- # tail -n +2 00:29:57.692 15:31:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:29:57.692 15:31:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:29:57.692 15:31:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:29:57.692 15:31:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:29:57.692 15:31:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:29:57.692 15:31:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:29:57.692 15:31:00 -- host/fio.sh@14 -- # [[ y != y ]] 00:29:57.692 15:31:00 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:29:57.692 15:31:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:29:57.692 15:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:57.692 15:31:00 -- host/fio.sh@22 -- # nvmfpid=778049 00:29:57.692 15:31:00 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:29:57.692 15:31:00 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:57.692 15:31:00 -- host/fio.sh@26 -- # waitforlisten 778049 00:29:57.692 15:31:00 -- common/autotest_common.sh@817 -- # '[' -z 778049 ']' 00:29:57.692 15:31:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:57.692 15:31:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:29:57.692 15:31:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:57.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:57.692 15:31:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:29:57.692 15:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:57.692 [2024-04-24 15:31:00.469639] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:29:57.692 [2024-04-24 15:31:00.469696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:57.692 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.692 [2024-04-24 15:31:00.550988] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:57.692 [2024-04-24 15:31:00.635104] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:57.692 [2024-04-24 15:31:00.635154] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:57.692 [2024-04-24 15:31:00.635164] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:29:57.692 [2024-04-24 15:31:00.635173] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:29:57.692 [2024-04-24 15:31:00.635181] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:57.692 [2024-04-24 15:31:00.635240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.692 [2024-04-24 15:31:00.635327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:57.692 [2024-04-24 15:31:00.635408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:57.692 [2024-04-24 15:31:00.635410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:57.692 15:31:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:29:57.692 15:31:01 -- common/autotest_common.sh@850 -- # return 0 00:29:57.692 15:31:01 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:29:57.692 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.692 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.692 [2024-04-24 15:31:01.306924] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1990910/0x198ff50) succeed. 00:29:57.692 [2024-04-24 15:31:01.317313] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1991c80/0x19904d0) succeed. 00:29:57.692 [2024-04-24 15:31:01.317347] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:29:57.692 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.692 15:31:01 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:29:57.692 15:31:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:29:57.692 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.692 15:31:01 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:29:57.692 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.692 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.692 Malloc1 00:29:57.692 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.692 15:31:01 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:57.693 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.693 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.693 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.693 15:31:01 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:29:57.693 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.693 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.693 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.693 15:31:01 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:29:57.693 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.693 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.693 [2024-04-24 15:31:01.417085] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:29:57.693 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.693 15:31:01 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:29:57.693 15:31:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:29:57.693 15:31:01 -- common/autotest_common.sh@10 -- # set +x 00:29:57.693 15:31:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:29:57.693 15:31:01 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme 00:29:57.693 15:31:01 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:57.693 15:31:01 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:57.693 15:31:01 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:29:57.693 15:31:01 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:57.693 15:31:01 -- common/autotest_common.sh@1325 -- # local sanitizers 00:29:57.693 15:31:01 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:29:57.693 15:31:01 -- common/autotest_common.sh@1327 -- # shift 00:29:57.693 15:31:01 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:29:57.693 15:31:01 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # grep libasan 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:57.693 15:31:01 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:57.693 15:31:01 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:29:57.693 15:31:01 -- common/autotest_common.sh@1331 -- # asan_lib= 00:29:57.693 15:31:01 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:29:57.693 15:31:01 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:29:57.693 15:31:01 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:29:57.952 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:29:57.952 fio-3.35 00:29:57.952 Starting 1 thread 00:29:57.952 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.489 00:30:00.489 test: (groupid=0, jobs=1): err= 0: pid=778341: Wed Apr 24 15:31:04 2024 00:30:00.489 read: IOPS=18.0k, BW=70.4MiB/s (73.8MB/s)(141MiB/2004msec) 00:30:00.489 slat (nsec): min=1383, max=31988, avg=1516.70, stdev=443.63 00:30:00.489 clat (usec): min=2191, max=6347, avg=3519.16, stdev=77.06 00:30:00.489 lat (usec): min=2206, max=6349, avg=3520.67, stdev=76.99 00:30:00.489 clat percentiles (usec): 00:30:00.489 | 1.00th=[ 3458], 5.00th=[ 3490], 10.00th=[ 3490], 20.00th=[ 3490], 00:30:00.489 | 30.00th=[ 3523], 40.00th=[ 3523], 50.00th=[ 3523], 60.00th=[ 3523], 00:30:00.489 | 70.00th=[ 3523], 80.00th=[ 3523], 90.00th=[ 3556], 95.00th=[ 3556], 00:30:00.489 | 99.00th=[ 3589], 99.50th=[ 3720], 99.90th=[ 4555], 99.95th=[ 5407], 00:30:00.489 | 99.99th=[ 6325] 00:30:00.489 bw ( KiB/s): min=70344, max=72904, per=100.00%, avg=72102.00, stdev=1188.07, samples=4 00:30:00.489 iops : min=17586, max=18226, avg=18025.50, stdev=297.02, samples=4 00:30:00.489 write: IOPS=18.0k, BW=70.5MiB/s (73.9MB/s)(141MiB/2004msec); 0 zone resets 00:30:00.490 slat (nsec): min=1434, max=22407, avg=1849.58, stdev=520.47 00:30:00.490 clat (usec): min=2204, max=6372, avg=3517.20, stdev=83.09 00:30:00.490 lat (usec): min=2215, max=6374, avg=3519.05, stdev=83.02 00:30:00.490 clat percentiles (usec): 00:30:00.490 | 1.00th=[ 3458], 5.00th=[ 3490], 10.00th=[ 3490], 20.00th=[ 3490], 00:30:00.490 | 30.00th=[ 3523], 40.00th=[ 3523], 50.00th=[ 3523], 60.00th=[ 3523], 00:30:00.490 | 70.00th=[ 3523], 80.00th=[ 3523], 90.00th=[ 3523], 95.00th=[ 3556], 00:30:00.490 | 99.00th=[ 3589], 99.50th=[ 3720], 99.90th=[ 4555], 99.95th=[ 5866], 00:30:00.490 | 99.99th=[ 6325] 00:30:00.490 bw ( KiB/s): min=70312, max=72984, per=100.00%, avg=72184.00, stdev=1266.53, samples=4 00:30:00.490 iops : min=17578, max=18246, avg=18046.00, stdev=316.63, samples=4 00:30:00.490 lat (msec) : 4=99.87%, 10=0.13% 00:30:00.490 cpu : usr=99.45%, sys=0.15%, ctx=8, majf=0, minf=3 00:30:00.490 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:30:00.490 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:00.490 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:00.490 issued rwts: total=36110,36160,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:00.490 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:00.490 00:30:00.490 Run status group 0 (all jobs): 00:30:00.490 READ: bw=70.4MiB/s (73.8MB/s), 70.4MiB/s-70.4MiB/s (73.8MB/s-73.8MB/s), io=141MiB (148MB), run=2004-2004msec 00:30:00.490 WRITE: bw=70.5MiB/s (73.9MB/s), 70.5MiB/s-70.5MiB/s (73.9MB/s-73.9MB/s), io=141MiB (148MB), run=2004-2004msec 00:30:00.490 15:31:04 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:00.490 15:31:04 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:00.490 15:31:04 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:00.490 15:31:04 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:00.490 15:31:04 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:00.490 15:31:04 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:00.490 15:31:04 -- common/autotest_common.sh@1327 -- # shift 00:30:00.490 15:31:04 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:00.490 15:31:04 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:00.490 15:31:04 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:00.490 15:31:04 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:00.490 15:31:04 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:00.490 15:31:04 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:00.490 15:31:04 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:00.490 15:31:04 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:00.749 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:30:00.749 fio-3.35 00:30:00.749 Starting 1 thread 00:30:00.749 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.289 00:30:03.289 test: (groupid=0, jobs=1): err= 0: pid=778776: Wed Apr 24 15:31:06 2024 00:30:03.289 read: IOPS=13.4k, BW=209MiB/s (219MB/s)(411MiB/1966msec) 00:30:03.289 slat (nsec): min=2309, max=44468, avg=2725.39, stdev=972.93 00:30:03.289 clat (usec): min=419, max=8359, avg=2165.10, stdev=1056.46 00:30:03.289 lat (usec): min=422, max=8377, avg=2167.82, stdev=1056.83 00:30:03.289 clat percentiles (usec): 00:30:03.289 | 1.00th=[ 906], 5.00th=[ 1172], 10.00th=[ 1287], 20.00th=[ 1450], 00:30:03.289 | 30.00th=[ 1582], 40.00th=[ 1713], 50.00th=[ 1860], 60.00th=[ 2040], 00:30:03.289 | 70.00th=[ 2245], 80.00th=[ 2638], 90.00th=[ 3359], 95.00th=[ 4752], 00:30:03.289 | 99.00th=[ 6456], 99.50th=[ 6849], 99.90th=[ 7177], 99.95th=[ 7439], 00:30:03.289 | 99.99th=[ 8029] 00:30:03.289 bw ( KiB/s): min=103680, max=105536, per=48.71%, avg=104272.00, stdev=854.87, samples=4 00:30:03.289 iops : min= 6480, max= 6596, avg=6517.00, stdev=53.43, samples=4 00:30:03.289 write: IOPS=7395, BW=116MiB/s (121MB/s)(212MiB/1837msec); 0 zone resets 00:30:03.289 slat (usec): min=27, max=110, avg=31.00, stdev= 5.43 00:30:03.289 clat (usec): min=4208, max=19132, avg=12654.89, stdev=1398.88 00:30:03.289 lat (usec): min=4238, max=19162, avg=12685.89, stdev=1398.87 00:30:03.289 clat percentiles (usec): 00:30:03.289 | 1.00th=[ 6915], 5.00th=[10945], 10.00th=[11338], 20.00th=[11731], 00:30:03.289 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12649], 60.00th=[12911], 00:30:03.289 | 70.00th=[13173], 80.00th=[13566], 90.00th=[14222], 95.00th=[15008], 00:30:03.289 | 99.00th=[15926], 99.50th=[16712], 99.90th=[17695], 99.95th=[17957], 00:30:03.289 | 99.99th=[19006] 00:30:03.289 bw ( KiB/s): min=106592, max=108832, per=91.27%, avg=107992.00, stdev=1072.32, samples=4 00:30:03.289 iops : min= 6662, max= 6802, avg=6749.50, stdev=67.02, samples=4 00:30:03.289 lat (usec) : 500=0.02%, 750=0.22%, 1000=0.98% 00:30:03.289 lat (msec) : 2=37.20%, 4=22.78%, 10=5.42%, 20=33.39% 00:30:03.289 cpu : usr=96.26%, sys=3.29%, ctx=88, majf=0, minf=2 00:30:03.289 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:30:03.289 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:03.289 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:03.289 issued rwts: total=26302,13585,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:03.289 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:03.289 00:30:03.289 Run status group 0 (all jobs): 00:30:03.289 READ: bw=209MiB/s (219MB/s), 209MiB/s-209MiB/s (219MB/s-219MB/s), io=411MiB (431MB), run=1966-1966msec 00:30:03.289 WRITE: bw=116MiB/s (121MB/s), 116MiB/s-116MiB/s (121MB/s-121MB/s), io=212MiB (223MB), run=1837-1837msec 00:30:03.289 15:31:06 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:03.289 15:31:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:03.289 15:31:06 -- common/autotest_common.sh@10 -- # set +x 00:30:03.289 15:31:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:03.289 15:31:06 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:30:03.289 15:31:06 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:30:03.289 15:31:06 -- host/fio.sh@49 -- # get_nvme_bdfs 00:30:03.289 15:31:06 -- common/autotest_common.sh@1499 -- # bdfs=() 00:30:03.289 15:31:06 -- common/autotest_common.sh@1499 -- # local bdfs 00:30:03.290 15:31:06 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:03.290 15:31:06 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:03.290 15:31:06 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:30:03.290 15:31:06 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:30:03.290 15:31:06 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5e:00.0 00:30:03.290 15:31:06 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 -i 192.168.100.8 00:30:03.290 15:31:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:03.290 15:31:06 -- common/autotest_common.sh@10 -- # set +x 00:30:06.591 Nvme0n1 00:30:06.591 15:31:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.591 15:31:09 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:30:06.591 15:31:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.591 15:31:09 -- common/autotest_common.sh@10 -- # set +x 00:30:16.635 15:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.635 15:31:20 -- host/fio.sh@51 -- # ls_guid=5c11c4ed-5aa2-4284-9d9c-47f73f7649db 00:30:16.635 15:31:20 -- host/fio.sh@52 -- # get_lvs_free_mb 5c11c4ed-5aa2-4284-9d9c-47f73f7649db 00:30:16.635 15:31:20 -- common/autotest_common.sh@1350 -- # local lvs_uuid=5c11c4ed-5aa2-4284-9d9c-47f73f7649db 00:30:16.635 15:31:20 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:16.635 15:31:20 -- common/autotest_common.sh@1352 -- # local fc 00:30:16.635 15:31:20 -- common/autotest_common.sh@1353 -- # local cs 00:30:16.635 15:31:20 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:16.635 15:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.635 15:31:20 -- common/autotest_common.sh@10 -- # set +x 00:30:16.635 15:31:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:16.635 15:31:20 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:16.635 { 00:30:16.635 "uuid": "5c11c4ed-5aa2-4284-9d9c-47f73f7649db", 00:30:16.635 "name": "lvs_0", 00:30:16.635 "base_bdev": "Nvme0n1", 00:30:16.635 "total_data_clusters": 3725, 00:30:16.635 "free_clusters": 3725, 00:30:16.635 "block_size": 512, 00:30:16.635 "cluster_size": 1073741824 00:30:16.635 } 00:30:16.635 ]' 00:30:16.635 15:31:20 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="5c11c4ed-5aa2-4284-9d9c-47f73f7649db") .free_clusters' 00:30:16.635 15:31:20 -- common/autotest_common.sh@1355 -- # fc=3725 00:30:16.635 15:31:20 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="5c11c4ed-5aa2-4284-9d9c-47f73f7649db") .cluster_size' 00:30:16.635 15:31:20 -- common/autotest_common.sh@1356 -- # cs=1073741824 00:30:16.635 15:31:20 -- common/autotest_common.sh@1359 -- # free_mb=3814400 00:30:16.635 15:31:20 -- common/autotest_common.sh@1360 -- # echo 3814400 00:30:16.635 3814400 00:30:16.635 15:31:20 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 3814400 00:30:16.635 15:31:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:16.635 15:31:20 -- common/autotest_common.sh@10 -- # set +x 00:30:17.573 1405da0e-fec2-4967-9ad7-b2e80ad1a218 00:30:17.573 15:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:17.573 15:31:21 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:30:17.573 15:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:17.573 15:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:17.573 15:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:17.573 15:31:21 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:30:17.573 15:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:17.573 15:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:17.573 15:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:17.573 15:31:21 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:30:17.573 15:31:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:17.573 15:31:21 -- common/autotest_common.sh@10 -- # set +x 00:30:17.573 15:31:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:17.573 15:31:21 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:17.573 15:31:21 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:17.573 15:31:21 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:17.573 15:31:21 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:17.573 15:31:21 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:17.573 15:31:21 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:17.573 15:31:21 -- common/autotest_common.sh@1327 -- # shift 00:30:17.573 15:31:21 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:17.573 15:31:21 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:17.573 15:31:21 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:17.573 15:31:21 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:17.573 15:31:21 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:17.573 15:31:21 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:17.573 15:31:21 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:17.573 15:31:21 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:17.573 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:17.573 fio-3.35 00:30:17.573 Starting 1 thread 00:30:17.832 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.366 00:30:20.366 test: (groupid=0, jobs=1): err= 0: pid=781112: Wed Apr 24 15:31:23 2024 00:30:20.366 read: IOPS=6450, BW=25.2MiB/s (26.4MB/s)(50.5MiB/2005msec) 00:30:20.366 slat (nsec): min=1394, max=19418, avg=1554.83, stdev=373.17 00:30:20.366 clat (usec): min=185, max=899056, avg=9876.60, stdev=63529.39 00:30:20.366 lat (usec): min=186, max=899073, avg=9878.16, stdev=63529.46 00:30:20.366 clat percentiles (msec): 00:30:20.366 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:30:20.366 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:30:20.367 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:20.367 | 99.00th=[ 6], 99.50th=[ 894], 99.90th=[ 902], 99.95th=[ 902], 00:30:20.367 | 99.99th=[ 902] 00:30:20.367 bw ( KiB/s): min= 384, max=47864, per=99.81%, avg=25754.00, stdev=25639.05, samples=4 00:30:20.367 iops : min= 96, max=11966, avg=6438.50, stdev=6409.76, samples=4 00:30:20.367 write: IOPS=6457, BW=25.2MiB/s (26.4MB/s)(50.6MiB/2005msec); 0 zone resets 00:30:20.367 slat (nsec): min=1451, max=17648, avg=1901.39, stdev=397.93 00:30:20.367 clat (usec): min=373, max=899407, avg=9637.87, stdev=61549.49 00:30:20.367 lat (usec): min=375, max=899410, avg=9639.77, stdev=61549.55 00:30:20.367 clat percentiles (msec): 00:30:20.367 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:30:20.367 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:30:20.367 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:20.367 | 99.00th=[ 6], 99.50th=[ 10], 99.90th=[ 902], 99.95th=[ 902], 00:30:20.367 | 99.99th=[ 902] 00:30:20.367 bw ( KiB/s): min= 416, max=47824, per=99.71%, avg=25754.00, stdev=25454.18, samples=4 00:30:20.367 iops : min= 104, max=11956, avg=6438.50, stdev=6363.55, samples=4 00:30:20.367 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.02% 00:30:20.367 lat (msec) : 2=0.09%, 4=0.32%, 10=99.04%, 1000=0.49% 00:30:20.367 cpu : usr=99.50%, sys=0.20%, ctx=8, majf=0, minf=3 00:30:20.367 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:30:20.367 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:20.367 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:20.367 issued rwts: total=12934,12947,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:20.367 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:20.367 00:30:20.367 Run status group 0 (all jobs): 00:30:20.367 READ: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.5MiB (53.0MB), run=2005-2005msec 00:30:20.367 WRITE: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.6MiB (53.0MB), run=2005-2005msec 00:30:20.367 15:31:23 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:30:20.367 15:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:20.367 15:31:23 -- common/autotest_common.sh@10 -- # set +x 00:30:20.367 15:31:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:20.367 15:31:23 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:30:20.367 15:31:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:20.367 15:31:23 -- common/autotest_common.sh@10 -- # set +x 00:30:22.281 15:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:22.281 15:31:26 -- host/fio.sh@62 -- # ls_nested_guid=80933c0f-9770-4ffa-9076-5e64123356b7 00:30:22.281 15:31:26 -- host/fio.sh@63 -- # get_lvs_free_mb 80933c0f-9770-4ffa-9076-5e64123356b7 00:30:22.281 15:31:26 -- common/autotest_common.sh@1350 -- # local lvs_uuid=80933c0f-9770-4ffa-9076-5e64123356b7 00:30:22.281 15:31:26 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:22.281 15:31:26 -- common/autotest_common.sh@1352 -- # local fc 00:30:22.281 15:31:26 -- common/autotest_common.sh@1353 -- # local cs 00:30:22.281 15:31:26 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:22.281 15:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:22.281 15:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:22.281 15:31:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:22.281 15:31:26 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:22.281 { 00:30:22.281 "uuid": "5c11c4ed-5aa2-4284-9d9c-47f73f7649db", 00:30:22.281 "name": "lvs_0", 00:30:22.281 "base_bdev": "Nvme0n1", 00:30:22.281 "total_data_clusters": 3725, 00:30:22.281 "free_clusters": 0, 00:30:22.281 "block_size": 512, 00:30:22.281 "cluster_size": 1073741824 00:30:22.281 }, 00:30:22.281 { 00:30:22.281 "uuid": "80933c0f-9770-4ffa-9076-5e64123356b7", 00:30:22.281 "name": "lvs_n_0", 00:30:22.281 "base_bdev": "1405da0e-fec2-4967-9ad7-b2e80ad1a218", 00:30:22.281 "total_data_clusters": 952668, 00:30:22.281 "free_clusters": 952668, 00:30:22.281 "block_size": 512, 00:30:22.281 "cluster_size": 4194304 00:30:22.281 } 00:30:22.281 ]' 00:30:22.281 15:31:26 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="80933c0f-9770-4ffa-9076-5e64123356b7") .free_clusters' 00:30:22.281 15:31:26 -- common/autotest_common.sh@1355 -- # fc=952668 00:30:22.544 15:31:26 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="80933c0f-9770-4ffa-9076-5e64123356b7") .cluster_size' 00:30:22.544 15:31:26 -- common/autotest_common.sh@1356 -- # cs=4194304 00:30:22.544 15:31:26 -- common/autotest_common.sh@1359 -- # free_mb=3810672 00:30:22.544 15:31:26 -- common/autotest_common.sh@1360 -- # echo 3810672 00:30:22.544 3810672 00:30:22.544 15:31:26 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 3810672 00:30:22.544 15:31:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:22.544 15:31:26 -- common/autotest_common.sh@10 -- # set +x 00:30:23.923 a21f5f00-c36a-495c-b49a-10fbc18c67b0 00:30:23.923 15:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:23.923 15:31:27 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:30:23.923 15:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:23.923 15:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:23.923 15:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:23.923 15:31:27 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:30:23.923 15:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:23.923 15:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:23.923 15:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:23.923 15:31:27 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:30:23.923 15:31:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:23.923 15:31:27 -- common/autotest_common.sh@10 -- # set +x 00:30:23.923 15:31:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:23.923 15:31:27 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:23.923 15:31:27 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:23.923 15:31:27 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:23.923 15:31:27 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:23.923 15:31:27 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:23.924 15:31:27 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:23.924 15:31:27 -- common/autotest_common.sh@1327 -- # shift 00:30:23.924 15:31:27 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:23.924 15:31:27 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:23.924 15:31:27 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:23.924 15:31:27 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:23.924 15:31:27 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:23.924 15:31:27 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:23.924 15:31:27 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:23.924 15:31:27 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:24.184 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:24.184 fio-3.35 00:30:24.184 Starting 1 thread 00:30:24.184 EAL: No free 2048 kB hugepages reported on node 1 00:30:26.720 00:30:26.720 test: (groupid=0, jobs=1): err= 0: pid=781945: Wed Apr 24 15:31:30 2024 00:30:26.720 read: IOPS=9920, BW=38.8MiB/s (40.6MB/s)(77.7MiB/2005msec) 00:30:26.720 slat (nsec): min=1394, max=21140, avg=1537.47, stdev=342.06 00:30:26.720 clat (usec): min=3515, max=10920, avg=6324.66, stdev=201.39 00:30:26.720 lat (usec): min=3518, max=10921, avg=6326.20, stdev=201.36 00:30:26.720 clat percentiles (usec): 00:30:26.720 | 1.00th=[ 6194], 5.00th=[ 6259], 10.00th=[ 6259], 20.00th=[ 6259], 00:30:26.720 | 30.00th=[ 6325], 40.00th=[ 6325], 50.00th=[ 6325], 60.00th=[ 6325], 00:30:26.720 | 70.00th=[ 6325], 80.00th=[ 6325], 90.00th=[ 6390], 95.00th=[ 6390], 00:30:26.720 | 99.00th=[ 6980], 99.50th=[ 7373], 99.90th=[ 9241], 99.95th=[10159], 00:30:26.720 | 99.99th=[10945] 00:30:26.720 bw ( KiB/s): min=37381, max=40832, per=99.90%, avg=39643.25, stdev=1581.28, samples=4 00:30:26.720 iops : min= 9345, max=10208, avg=9910.75, stdev=395.44, samples=4 00:30:26.720 write: IOPS=9943, BW=38.8MiB/s (40.7MB/s)(77.9MiB/2005msec); 0 zone resets 00:30:26.720 slat (nsec): min=1448, max=17927, avg=1890.84, stdev=378.79 00:30:26.720 clat (usec): min=3523, max=10971, avg=6344.17, stdev=220.21 00:30:26.720 lat (usec): min=3527, max=10973, avg=6346.06, stdev=220.18 00:30:26.720 clat percentiles (usec): 00:30:26.720 | 1.00th=[ 6259], 5.00th=[ 6259], 10.00th=[ 6259], 20.00th=[ 6325], 00:30:26.720 | 30.00th=[ 6325], 40.00th=[ 6325], 50.00th=[ 6325], 60.00th=[ 6325], 00:30:26.720 | 70.00th=[ 6325], 80.00th=[ 6390], 90.00th=[ 6390], 95.00th=[ 6390], 00:30:26.720 | 99.00th=[ 7046], 99.50th=[ 7373], 99.90th=[10159], 99.95th=[10945], 00:30:26.720 | 99.99th=[10945] 00:30:26.720 bw ( KiB/s): min=38011, max=40528, per=99.86%, avg=39716.75, stdev=1153.93, samples=4 00:30:26.720 iops : min= 9502, max=10132, avg=9929.00, stdev=288.85, samples=4 00:30:26.720 lat (msec) : 4=0.06%, 10=99.87%, 20=0.08% 00:30:26.720 cpu : usr=99.40%, sys=0.35%, ctx=8, majf=0, minf=3 00:30:26.720 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:30:26.720 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:26.720 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:26.720 issued rwts: total=19890,19936,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:26.720 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:26.720 00:30:26.720 Run status group 0 (all jobs): 00:30:26.720 READ: bw=38.8MiB/s (40.6MB/s), 38.8MiB/s-38.8MiB/s (40.6MB/s-40.6MB/s), io=77.7MiB (81.5MB), run=2005-2005msec 00:30:26.720 WRITE: bw=38.8MiB/s (40.7MB/s), 38.8MiB/s-38.8MiB/s (40.7MB/s-40.7MB/s), io=77.9MiB (81.7MB), run=2005-2005msec 00:30:26.720 15:31:30 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:30:26.720 15:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:26.720 15:31:30 -- common/autotest_common.sh@10 -- # set +x 00:30:26.720 15:31:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:26.720 15:31:30 -- host/fio.sh@72 -- # sync 00:30:26.720 15:31:30 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:30:26.720 15:31:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:26.720 15:31:30 -- common/autotest_common.sh@10 -- # set +x 00:30:41.611 15:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:41.611 15:31:44 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:30:41.611 15:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:41.611 15:31:44 -- common/autotest_common.sh@10 -- # set +x 00:30:41.611 15:31:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:41.611 15:31:44 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:30:41.611 15:31:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:41.611 15:31:44 -- common/autotest_common.sh@10 -- # set +x 00:30:53.826 15:31:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:53.826 15:31:55 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:30:53.826 15:31:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:53.826 15:31:55 -- common/autotest_common.sh@10 -- # set +x 00:30:53.826 15:31:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:53.826 15:31:55 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:30:53.826 15:31:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:53.826 15:31:55 -- common/autotest_common.sh@10 -- # set +x 00:30:57.119 15:32:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:57.119 15:32:00 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:30:57.119 15:32:00 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:30:57.119 15:32:00 -- host/fio.sh@84 -- # nvmftestfini 00:30:57.119 15:32:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:30:57.119 15:32:00 -- nvmf/common.sh@117 -- # sync 00:30:57.119 15:32:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:30:57.119 15:32:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:30:57.119 15:32:00 -- nvmf/common.sh@120 -- # set +e 00:30:57.119 15:32:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:30:57.119 15:32:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:30:57.119 rmmod nvme_rdma 00:30:57.119 rmmod nvme_fabrics 00:30:57.119 15:32:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:30:57.119 15:32:00 -- nvmf/common.sh@124 -- # set -e 00:30:57.119 15:32:00 -- nvmf/common.sh@125 -- # return 0 00:30:57.119 15:32:00 -- nvmf/common.sh@478 -- # '[' -n 778049 ']' 00:30:57.119 15:32:00 -- nvmf/common.sh@479 -- # killprocess 778049 00:30:57.119 15:32:00 -- common/autotest_common.sh@936 -- # '[' -z 778049 ']' 00:30:57.119 15:32:00 -- common/autotest_common.sh@940 -- # kill -0 778049 00:30:57.119 15:32:00 -- common/autotest_common.sh@941 -- # uname 00:30:57.119 15:32:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:57.119 15:32:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 778049 00:30:57.119 15:32:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:57.119 15:32:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:57.119 15:32:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 778049' 00:30:57.119 killing process with pid 778049 00:30:57.119 15:32:00 -- common/autotest_common.sh@955 -- # kill 778049 00:30:57.119 15:32:00 -- common/autotest_common.sh@960 -- # wait 778049 00:30:57.119 [2024-04-24 15:32:00.711257] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:30:57.119 15:32:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:57.119 15:32:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:30:57.119 00:30:57.119 real 1m7.726s 00:30:57.119 user 4m22.055s 00:30:57.119 sys 0m7.067s 00:30:57.119 15:32:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:57.119 15:32:00 -- common/autotest_common.sh@10 -- # set +x 00:30:57.119 ************************************ 00:30:57.119 END TEST nvmf_fio_host 00:30:57.119 ************************************ 00:30:57.119 15:32:00 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:30:57.119 15:32:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:57.119 15:32:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:57.119 15:32:00 -- common/autotest_common.sh@10 -- # set +x 00:30:57.379 ************************************ 00:30:57.379 START TEST nvmf_failover 00:30:57.379 ************************************ 00:30:57.379 15:32:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:30:57.379 * Looking for test storage... 00:30:57.379 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:30:57.379 15:32:01 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:30:57.379 15:32:01 -- nvmf/common.sh@7 -- # uname -s 00:30:57.379 15:32:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:57.379 15:32:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:57.379 15:32:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:57.379 15:32:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:57.379 15:32:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:57.379 15:32:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:57.379 15:32:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:57.379 15:32:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:57.379 15:32:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:57.379 15:32:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:57.379 15:32:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:30:57.379 15:32:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:30:57.379 15:32:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:57.379 15:32:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:57.379 15:32:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:57.379 15:32:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:57.379 15:32:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:30:57.379 15:32:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:57.639 15:32:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:57.639 15:32:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:57.639 15:32:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.639 15:32:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.639 15:32:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.639 15:32:01 -- paths/export.sh@5 -- # export PATH 00:30:57.639 15:32:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:57.639 15:32:01 -- nvmf/common.sh@47 -- # : 0 00:30:57.639 15:32:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:57.639 15:32:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:57.639 15:32:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:57.639 15:32:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:57.639 15:32:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:57.639 15:32:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:57.639 15:32:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:57.639 15:32:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:57.639 15:32:01 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:57.639 15:32:01 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:57.639 15:32:01 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py 00:30:57.639 15:32:01 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:30:57.639 15:32:01 -- host/failover.sh@18 -- # nvmftestinit 00:30:57.639 15:32:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:30:57.639 15:32:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:57.639 15:32:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:57.639 15:32:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:57.639 15:32:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:57.639 15:32:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:57.639 15:32:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:57.639 15:32:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:57.639 15:32:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:57.639 15:32:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:57.639 15:32:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:57.639 15:32:01 -- common/autotest_common.sh@10 -- # set +x 00:31:05.766 15:32:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:05.766 15:32:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:05.766 15:32:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:05.766 15:32:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:05.766 15:32:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:05.766 15:32:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:05.766 15:32:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:05.766 15:32:08 -- nvmf/common.sh@295 -- # net_devs=() 00:31:05.766 15:32:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:05.766 15:32:08 -- nvmf/common.sh@296 -- # e810=() 00:31:05.766 15:32:08 -- nvmf/common.sh@296 -- # local -ga e810 00:31:05.766 15:32:08 -- nvmf/common.sh@297 -- # x722=() 00:31:05.766 15:32:08 -- nvmf/common.sh@297 -- # local -ga x722 00:31:05.766 15:32:08 -- nvmf/common.sh@298 -- # mlx=() 00:31:05.766 15:32:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:05.766 15:32:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:05.766 15:32:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:05.767 15:32:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:05.767 15:32:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:05.767 15:32:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:05.767 15:32:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:05.767 15:32:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:31:05.767 Found 0000:18:00.0 (0x8086 - 0x1592) 00:31:05.767 15:32:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:05.767 15:32:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:31:05.767 Found 0000:18:00.1 (0x8086 - 0x1592) 00:31:05.767 15:32:08 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:05.767 15:32:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@377 -- # modinfo irdma 00:31:05.767 15:32:08 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:31:05.767 15:32:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:05.767 15:32:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:05.767 15:32:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:31:05.767 Found net devices under 0000:18:00.0: cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:05.767 15:32:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:05.767 15:32:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:31:05.767 Found net devices under 0000:18:00.1: cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:05.767 15:32:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:05.767 15:32:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:05.767 15:32:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:05.767 15:32:08 -- nvmf/common.sh@58 -- # uname 00:31:05.767 15:32:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:05.767 15:32:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:05.767 15:32:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:05.767 15:32:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:05.767 15:32:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:05.767 15:32:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:05.767 15:32:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:05.767 15:32:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:05.767 15:32:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:05.767 15:32:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:05.767 15:32:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:05.767 15:32:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:05.767 15:32:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:05.767 15:32:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:05.767 15:32:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:05.767 15:32:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@105 -- # continue 2 00:31:05.767 15:32:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@105 -- # continue 2 00:31:05.767 15:32:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:05.767 15:32:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:05.767 15:32:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:05.767 15:32:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:31:05.767 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:31:05.767 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:31:05.767 altname enp24s0f0np0 00:31:05.767 altname ens785f0np0 00:31:05.767 inet 192.168.100.8/24 scope global cvl_0_0 00:31:05.767 valid_lft forever preferred_lft forever 00:31:05.767 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:31:05.767 valid_lft forever preferred_lft forever 00:31:05.767 15:32:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:05.767 15:32:08 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:05.767 15:32:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:05.767 15:32:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:31:05.767 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:31:05.767 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:31:05.767 altname enp24s0f1np1 00:31:05.767 altname ens785f1np1 00:31:05.767 inet 192.168.100.9/24 scope global cvl_0_1 00:31:05.767 valid_lft forever preferred_lft forever 00:31:05.767 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:31:05.767 valid_lft forever preferred_lft forever 00:31:05.767 15:32:08 -- nvmf/common.sh@411 -- # return 0 00:31:05.767 15:32:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:05.767 15:32:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:05.767 15:32:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:05.767 15:32:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:05.767 15:32:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:05.767 15:32:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:05.767 15:32:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:05.767 15:32:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:05.767 15:32:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:05.767 15:32:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@105 -- # continue 2 00:31:05.767 15:32:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:05.767 15:32:08 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:31:05.767 15:32:08 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@105 -- # continue 2 00:31:05.767 15:32:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:05.767 15:32:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:05.767 15:32:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:05.767 15:32:08 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:05.767 15:32:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:05.767 15:32:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:05.767 192.168.100.9' 00:31:05.767 15:32:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:05.767 192.168.100.9' 00:31:05.767 15:32:08 -- nvmf/common.sh@446 -- # head -n 1 00:31:05.768 15:32:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:05.768 15:32:08 -- nvmf/common.sh@447 -- # tail -n +2 00:31:05.768 15:32:08 -- nvmf/common.sh@447 -- # head -n 1 00:31:05.768 15:32:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:05.768 192.168.100.9' 00:31:05.768 15:32:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:05.768 15:32:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:05.768 15:32:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:05.768 15:32:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:05.768 15:32:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:05.768 15:32:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:05.768 15:32:08 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:31:05.768 15:32:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:31:05.768 15:32:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:31:05.768 15:32:08 -- common/autotest_common.sh@10 -- # set +x 00:31:05.768 15:32:08 -- nvmf/common.sh@470 -- # nvmfpid=789427 00:31:05.768 15:32:08 -- nvmf/common.sh@471 -- # waitforlisten 789427 00:31:05.768 15:32:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:05.768 15:32:08 -- common/autotest_common.sh@817 -- # '[' -z 789427 ']' 00:31:05.768 15:32:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:05.768 15:32:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:05.768 15:32:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:05.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:05.768 15:32:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:05.768 15:32:08 -- common/autotest_common.sh@10 -- # set +x 00:31:05.768 [2024-04-24 15:32:08.589027] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:31:05.768 [2024-04-24 15:32:08.589088] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:05.768 EAL: No free 2048 kB hugepages reported on node 1 00:31:05.768 [2024-04-24 15:32:08.670049] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:05.768 [2024-04-24 15:32:08.754663] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:05.768 [2024-04-24 15:32:08.754712] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:05.768 [2024-04-24 15:32:08.754722] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:31:05.768 [2024-04-24 15:32:08.754730] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:31:05.768 [2024-04-24 15:32:08.754737] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:05.768 [2024-04-24 15:32:08.754840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:05.768 [2024-04-24 15:32:08.754913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:05.768 [2024-04-24 15:32:08.754915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:05.768 15:32:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:05.768 15:32:09 -- common/autotest_common.sh@850 -- # return 0 00:31:05.768 15:32:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:31:05.768 15:32:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:05.768 15:32:09 -- common/autotest_common.sh@10 -- # set +x 00:31:05.768 15:32:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:05.768 15:32:09 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:31:05.768 [2024-04-24 15:32:09.620997] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xd610e0/0xd60720) succeed. 00:31:05.768 [2024-04-24 15:32:09.631292] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xd62410/0xd60ca0) succeed. 00:31:05.768 [2024-04-24 15:32:09.631314] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:31:05.768 15:32:09 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:31:06.027 Malloc0 00:31:06.027 15:32:09 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:06.286 15:32:10 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:06.546 15:32:10 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:06.546 [2024-04-24 15:32:10.416980] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:31:06.546 15:32:10 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:06.805 [2024-04-24 15:32:10.593574] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:31:06.805 15:32:10 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:07.064 [2024-04-24 15:32:10.778200] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:31:07.064 15:32:10 -- host/failover.sh@31 -- # bdevperf_pid=789684 00:31:07.064 15:32:10 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:31:07.064 15:32:10 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:07.064 15:32:10 -- host/failover.sh@34 -- # waitforlisten 789684 /var/tmp/bdevperf.sock 00:31:07.064 15:32:10 -- common/autotest_common.sh@817 -- # '[' -z 789684 ']' 00:31:07.064 15:32:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:31:07.065 15:32:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:07.065 15:32:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:31:07.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:31:07.065 15:32:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:07.065 15:32:10 -- common/autotest_common.sh@10 -- # set +x 00:31:08.003 15:32:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:08.003 15:32:11 -- common/autotest_common.sh@850 -- # return 0 00:31:08.003 15:32:11 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:08.003 NVMe0n1 00:31:08.282 15:32:11 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:08.282 00:31:08.282 15:32:12 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:31:08.282 15:32:12 -- host/failover.sh@39 -- # run_test_pid=789869 00:31:08.282 15:32:12 -- host/failover.sh@41 -- # sleep 1 00:31:09.290 15:32:13 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:09.549 15:32:13 -- host/failover.sh@45 -- # sleep 3 00:31:12.841 15:32:16 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:12.841 00:31:12.841 15:32:16 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:13.100 15:32:16 -- host/failover.sh@50 -- # sleep 3 00:31:16.389 15:32:19 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:16.390 [2024-04-24 15:32:19.938526] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:31:16.390 15:32:19 -- host/failover.sh@55 -- # sleep 1 00:31:17.327 15:32:20 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:17.327 15:32:21 -- host/failover.sh@59 -- # wait 789869 00:31:23.908 0 00:31:23.908 15:32:27 -- host/failover.sh@61 -- # killprocess 789684 00:31:23.908 15:32:27 -- common/autotest_common.sh@936 -- # '[' -z 789684 ']' 00:31:23.908 15:32:27 -- common/autotest_common.sh@940 -- # kill -0 789684 00:31:23.908 15:32:27 -- common/autotest_common.sh@941 -- # uname 00:31:23.908 15:32:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:23.908 15:32:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 789684 00:31:23.908 15:32:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:23.908 15:32:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:23.908 15:32:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 789684' 00:31:23.908 killing process with pid 789684 00:31:23.908 15:32:27 -- common/autotest_common.sh@955 -- # kill 789684 00:31:23.908 15:32:27 -- common/autotest_common.sh@960 -- # wait 789684 00:31:23.908 15:32:27 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:23.908 [2024-04-24 15:32:10.850733] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:31:23.908 [2024-04-24 15:32:10.850789] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid789684 ] 00:31:23.908 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.908 [2024-04-24 15:32:10.929758] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:23.908 [2024-04-24 15:32:11.007254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:23.909 Running I/O for 15 seconds... 00:31:23.909 [2024-04-24 15:32:13.876782] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.909 [2024-04-24 15:32:13.876832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:28312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:28328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:28336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:28360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.876988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:28368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.876999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:28392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:28400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:28416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:28424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:28432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:28448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:28456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:28472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:28480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:28488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:28496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:28512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:28520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x4d62954f 00:31:23.909 [2024-04-24 15:32:13.877411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.909 [2024-04-24 15:32:13.877422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:28528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:28536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:28552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:28584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:28592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:28608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:28624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:28632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:28640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:28656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:28664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x4d62954f 00:31:23.910 [2024-04-24 15:32:13.877787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:28672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:28680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:28688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:28696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:28720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.877980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:28744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.877990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.878002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:28752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.878012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.910 [2024-04-24 15:32:13.878023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:28760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.910 [2024-04-24 15:32:13.878032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:28776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:28784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:28800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:28808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:28816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:28832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:28840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:28848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:28864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:28872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:28880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:28920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:28928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:28936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:28952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:28960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:28976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:28984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:28992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:29000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:29008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.911 [2024-04-24 15:32:13.878689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.911 [2024-04-24 15:32:13.878700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:29024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:29032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:29040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:29048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:29064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:29072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:29080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:29088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:29096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:29104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:29112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:29120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.878985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:29136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.878994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:29144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:29152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:29160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:29168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:29176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:29184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:29192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:29216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:29224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:29232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:29240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:29248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:29256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:29264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:29272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:29280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:29288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:29296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.912 [2024-04-24 15:32:13.879426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:29312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.912 [2024-04-24 15:32:13.879436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:13.879446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:13.879456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4a00 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:13.879724] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:23.913 [2024-04-24 15:32:13.879736] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:23.913 [2024-04-24 15:32:13.879745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29328 len:8 PRP1 0x0 PRP2 0x0 00:31:23.913 [2024-04-24 15:32:13.879755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:13.879795] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:31:23.913 [2024-04-24 15:32:13.879807] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:23.913 [2024-04-24 15:32:13.879817] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:23.913 [2024-04-24 15:32:13.882575] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:23.913 [2024-04-24 15:32:13.882615] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.913 [2024-04-24 15:32:13.895672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:23.913 [2024-04-24 15:32:13.942384] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:23.913 [2024-04-24 15:32:17.268506] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.913 [2024-04-24 15:32:17.268563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:58680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:58688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:58696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:58704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:58712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:58720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:58728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:58736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:58744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:58752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:58760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.268810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:59216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:59224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:59232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:59240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:59248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:59256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:59264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:59272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.913 [2024-04-24 15:32:17.268985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.268995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:58768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:58776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:58784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:58792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:58800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:58808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.913 [2024-04-24 15:32:17.269121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:58816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0xa5a383f5 00:31:23.913 [2024-04-24 15:32:17.269130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:58824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0xa5a383f5 00:31:23.914 [2024-04-24 15:32:17.269151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:59280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:59288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:59296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:59304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:59312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:59320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:59328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:59336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:59344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:59352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:59360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:59368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:59376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:59384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:59392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:59400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:59408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:59416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:59424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:59432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:59440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:59448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:59456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.914 [2024-04-24 15:32:17.269627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:58832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0xa5a383f5 00:31:23.914 [2024-04-24 15:32:17.269648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:58840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0xa5a383f5 00:31:23.914 [2024-04-24 15:32:17.269669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.914 [2024-04-24 15:32:17.269680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:58848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:58856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:58864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:58872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:58880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:58888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:59464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:59472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:59480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:59488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:59496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:59504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:59512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:59520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.269959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:58896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.269979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.269992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:58904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:58912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:58920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:58928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:58936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:58944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:58952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0xa5a383f5 00:31:23.915 [2024-04-24 15:32:17.270128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:59528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:59536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:59544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:59552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:59560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:59568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:59576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:59584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:59592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:59600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:59608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:59616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:59624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.915 [2024-04-24 15:32:17.270398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.915 [2024-04-24 15:32:17.270409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:59632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.916 [2024-04-24 15:32:17.270418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:59640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.916 [2024-04-24 15:32:17.270439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:59648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.916 [2024-04-24 15:32:17.270459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:59656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.916 [2024-04-24 15:32:17.270478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:58960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:58968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:58976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:58984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:58992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:59000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:59008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:59016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:59024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:59032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:59040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:59048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:59056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:59064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:59072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:59080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:59088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:59096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:59104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:59112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:59120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:59128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:59136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:59144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.270989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.270999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:59152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.271009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.271019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:59160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.271029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.271040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:59168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0xa5a383f5 00:31:23.916 [2024-04-24 15:32:17.271049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.916 [2024-04-24 15:32:17.271060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:59176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0xa5a383f5 00:31:23.917 [2024-04-24 15:32:17.271069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:59184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0xa5a383f5 00:31:23.917 [2024-04-24 15:32:17.271089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:59192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0xa5a383f5 00:31:23.917 [2024-04-24 15:32:17.271110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:59200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0xa5a383f5 00:31:23.917 [2024-04-24 15:32:17.271130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:59208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0xa5a383f5 00:31:23.917 [2024-04-24 15:32:17.271150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:59664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:17.271171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:59672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:17.271190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:59680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:17.271213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:59688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:17.271234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:20e6610 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271514] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:23.917 [2024-04-24 15:32:17.271528] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:23.917 [2024-04-24 15:32:17.271537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:59696 len:8 PRP1 0x0 PRP2 0x0 00:31:23.917 [2024-04-24 15:32:17.271546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:17.271592] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:23.917 [2024-04-24 15:32:17.271604] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:31:23.917 [2024-04-24 15:32:17.271615] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:23.917 [2024-04-24 15:32:17.274378] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:23.917 [2024-04-24 15:32:17.274422] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.917 [2024-04-24 15:32:17.287375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:23.917 [2024-04-24 15:32:17.337887] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:23.917 [2024-04-24 15:32:21.684507] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.917 [2024-04-24 15:32:21.684557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:114560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:21.684569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:114096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:114104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:114120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:114136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:114144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0xfd53bb82 00:31:23.917 [2024-04-24 15:32:21.684727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.917 [2024-04-24 15:32:21.684738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:114568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.917 [2024-04-24 15:32:21.684748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:114576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:114584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:114592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:114600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:114608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:114616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:114624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:114632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:114640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:114648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:114656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.684985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.684997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:114664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:114672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:114680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:114688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:114696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:114704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:114712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:114720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:114728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:114736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:114744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:114752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:114152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0xfd53bb82 00:31:23.918 [2024-04-24 15:32:21.685249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:114760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:114768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:114776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:114784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.918 [2024-04-24 15:32:21.685330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.918 [2024-04-24 15:32:21.685340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:114792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.919 [2024-04-24 15:32:21.685349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:114160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:114168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:114184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:114192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:114216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:114224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:114232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:114240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:114248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:114272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:114280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0xfd53bb82 00:31:23.919 [2024-04-24 15:32:21.685692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:114800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.919 [2024-04-24 15:32:21.685711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:114808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.919 [2024-04-24 15:32:21.685731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.919 [2024-04-24 15:32:21.685742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:114816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:114824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:114832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:114840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:114848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:114856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:114864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:114872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:114880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:114888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:114896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:114904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:114912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.685986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.685996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:114920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:114928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:114936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:114944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:114952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:114960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:114968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:114976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.920 [2024-04-24 15:32:21.686154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:114984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.920 [2024-04-24 15:32:21.686163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:114288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:114304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:114992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:115000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:115008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:115016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:115024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:115032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:115040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:115048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:115056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:115064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:115080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:115088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:115096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:115104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:115112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:23.921 [2024-04-24 15:32:21.686560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:114312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:114328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:114336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:114344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.921 [2024-04-24 15:32:21.686697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0xfd53bb82 00:31:23.921 [2024-04-24 15:32:21.686707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:114376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:114384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:114392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:114400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:114408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:114416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:114432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:114440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:114456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:114464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.686987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:114472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.686996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:114480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:114488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:114496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:114504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:114512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:114520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:114528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:114536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:114544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0xfd53bb82 00:31:23.922 [2024-04-24 15:32:21.687180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:2178290 sqhd:4940 p:0 m:0 dnr:0 00:31:23.922 [2024-04-24 15:32:21.687454] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:23.923 [2024-04-24 15:32:21.687465] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:23.923 [2024-04-24 15:32:21.687474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114552 len:8 PRP1 0x0 PRP2 0x0 00:31:23.923 [2024-04-24 15:32:21.687483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:23.923 [2024-04-24 15:32:21.687526] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:23.923 [2024-04-24 15:32:21.687537] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:31:23.923 [2024-04-24 15:32:21.687547] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:23.923 [2024-04-24 15:32:21.687577] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:31:23.923 [2024-04-24 15:32:21.687590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:23.923 [2024-04-24 15:32:21.687600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:20e6610 sqhd:d080 p:0 m:0 dnr:0 00:31:23.923 [2024-04-24 15:32:21.687611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:23.923 [2024-04-24 15:32:21.687620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:20e6610 sqhd:d080 p:0 m:0 dnr:0 00:31:23.923 [2024-04-24 15:32:21.687632] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:23.923 [2024-04-24 15:32:21.687641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:20e6610 sqhd:d080 p:0 m:0 dnr:0 00:31:23.923 [2024-04-24 15:32:21.687652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:23.923 [2024-04-24 15:32:21.687661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:20e6610 sqhd:d080 p:0 m:0 dnr:0 00:31:23.923 [2024-04-24 15:32:21.700631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:23.923 [2024-04-24 15:32:21.700654] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:31:23.923 [2024-04-24 15:32:21.700665] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:23.923 [2024-04-24 15:32:21.703403] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:23.923 [2024-04-24 15:32:21.751863] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:23.923 00:31:23.923 Latency(us) 00:31:23.923 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:23.923 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:23.923 Verification LBA range: start 0x0 length 0x4000 00:31:23.923 NVMe0n1 : 15.01 16253.76 63.49 324.48 0.00 7699.53 356.17 579908.12 00:31:23.923 =================================================================================================================== 00:31:23.923 Total : 16253.76 63.49 324.48 0.00 7699.53 356.17 579908.12 00:31:23.923 Received shutdown signal, test time was about 15.000000 seconds 00:31:23.923 00:31:23.923 Latency(us) 00:31:23.923 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:23.923 =================================================================================================================== 00:31:23.923 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:23.923 15:32:27 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:31:23.923 15:32:27 -- host/failover.sh@65 -- # count=3 00:31:23.923 15:32:27 -- host/failover.sh@67 -- # (( count != 3 )) 00:31:23.923 15:32:27 -- host/failover.sh@73 -- # bdevperf_pid=791803 00:31:23.923 15:32:27 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:31:23.923 15:32:27 -- host/failover.sh@75 -- # waitforlisten 791803 /var/tmp/bdevperf.sock 00:31:23.923 15:32:27 -- common/autotest_common.sh@817 -- # '[' -z 791803 ']' 00:31:23.923 15:32:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:31:23.923 15:32:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:23.923 15:32:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:31:23.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:31:23.923 15:32:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:23.923 15:32:27 -- common/autotest_common.sh@10 -- # set +x 00:31:24.859 15:32:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:24.859 15:32:28 -- common/autotest_common.sh@850 -- # return 0 00:31:24.859 15:32:28 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:24.859 [2024-04-24 15:32:28.609224] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:31:24.859 15:32:28 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:25.118 [2024-04-24 15:32:28.777781] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:31:25.118 15:32:28 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:25.377 NVMe0n1 00:31:25.377 15:32:29 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:25.377 00:31:25.635 15:32:29 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:25.635 00:31:25.635 15:32:29 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:25.635 15:32:29 -- host/failover.sh@82 -- # grep -q NVMe0 00:31:25.894 15:32:29 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:26.153 15:32:29 -- host/failover.sh@87 -- # sleep 3 00:31:29.445 15:32:32 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:29.445 15:32:32 -- host/failover.sh@88 -- # grep -q NVMe0 00:31:29.445 15:32:33 -- host/failover.sh@90 -- # run_test_pid=792510 00:31:29.445 15:32:33 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:31:29.445 15:32:33 -- host/failover.sh@92 -- # wait 792510 00:31:30.384 0 00:31:30.384 15:32:34 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:30.384 [2024-04-24 15:32:27.630422] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:31:30.384 [2024-04-24 15:32:27.630479] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid791803 ] 00:31:30.384 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.384 [2024-04-24 15:32:27.709315] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:30.384 [2024-04-24 15:32:27.786514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:30.384 [2024-04-24 15:32:29.866111] bdev_nvme.c:1856:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:30.384 [2024-04-24 15:32:29.867336] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:30.384 [2024-04-24 15:32:29.867371] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:30.384 [2024-04-24 15:32:29.890227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:30.384 [2024-04-24 15:32:29.907792] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:30.384 Running I/O for 1 seconds... 00:31:30.384 00:31:30.384 Latency(us) 00:31:30.384 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:30.384 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:30.384 Verification LBA range: start 0x0 length 0x4000 00:31:30.384 NVMe0n1 : 1.00 18243.29 71.26 0.00 0.00 6978.39 2478.97 18919.96 00:31:30.384 =================================================================================================================== 00:31:30.384 Total : 18243.29 71.26 0.00 0.00 6978.39 2478.97 18919.96 00:31:30.384 15:32:34 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:30.384 15:32:34 -- host/failover.sh@95 -- # grep -q NVMe0 00:31:30.642 15:32:34 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:30.901 15:32:34 -- host/failover.sh@99 -- # grep -q NVMe0 00:31:30.901 15:32:34 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:30.901 15:32:34 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:31.161 15:32:34 -- host/failover.sh@101 -- # sleep 3 00:31:34.453 15:32:37 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:34.453 15:32:37 -- host/failover.sh@103 -- # grep -q NVMe0 00:31:34.453 15:32:38 -- host/failover.sh@108 -- # killprocess 791803 00:31:34.453 15:32:38 -- common/autotest_common.sh@936 -- # '[' -z 791803 ']' 00:31:34.453 15:32:38 -- common/autotest_common.sh@940 -- # kill -0 791803 00:31:34.453 15:32:38 -- common/autotest_common.sh@941 -- # uname 00:31:34.453 15:32:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:34.453 15:32:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 791803 00:31:34.453 15:32:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:34.453 15:32:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:34.453 15:32:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 791803' 00:31:34.453 killing process with pid 791803 00:31:34.453 15:32:38 -- common/autotest_common.sh@955 -- # kill 791803 00:31:34.453 15:32:38 -- common/autotest_common.sh@960 -- # wait 791803 00:31:34.712 15:32:38 -- host/failover.sh@110 -- # sync 00:31:34.712 15:32:38 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:34.712 15:32:38 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:31:34.712 15:32:38 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:34.712 15:32:38 -- host/failover.sh@116 -- # nvmftestfini 00:31:34.712 15:32:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:34.712 15:32:38 -- nvmf/common.sh@117 -- # sync 00:31:34.712 15:32:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:34.712 15:32:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:34.712 15:32:38 -- nvmf/common.sh@120 -- # set +e 00:31:34.712 15:32:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:34.712 15:32:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:34.712 rmmod nvme_rdma 00:31:34.712 rmmod nvme_fabrics 00:31:34.972 15:32:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:34.972 15:32:38 -- nvmf/common.sh@124 -- # set -e 00:31:34.972 15:32:38 -- nvmf/common.sh@125 -- # return 0 00:31:34.972 15:32:38 -- nvmf/common.sh@478 -- # '[' -n 789427 ']' 00:31:34.972 15:32:38 -- nvmf/common.sh@479 -- # killprocess 789427 00:31:34.972 15:32:38 -- common/autotest_common.sh@936 -- # '[' -z 789427 ']' 00:31:34.972 15:32:38 -- common/autotest_common.sh@940 -- # kill -0 789427 00:31:34.972 15:32:38 -- common/autotest_common.sh@941 -- # uname 00:31:34.972 15:32:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:34.972 15:32:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 789427 00:31:34.972 15:32:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:34.972 15:32:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:34.972 15:32:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 789427' 00:31:34.972 killing process with pid 789427 00:31:34.972 15:32:38 -- common/autotest_common.sh@955 -- # kill 789427 00:31:34.972 15:32:38 -- common/autotest_common.sh@960 -- # wait 789427 00:31:34.972 [2024-04-24 15:32:38.724321] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:31:35.232 15:32:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:35.232 15:32:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:35.232 00:31:35.232 real 0m37.807s 00:31:35.232 user 2m3.989s 00:31:35.232 sys 0m7.868s 00:31:35.232 15:32:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:35.232 15:32:38 -- common/autotest_common.sh@10 -- # set +x 00:31:35.232 ************************************ 00:31:35.232 END TEST nvmf_failover 00:31:35.232 ************************************ 00:31:35.232 15:32:39 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:35.232 15:32:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:35.232 15:32:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:35.232 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:35.492 ************************************ 00:31:35.492 START TEST nvmf_discovery 00:31:35.492 ************************************ 00:31:35.492 15:32:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:35.492 * Looking for test storage... 00:31:35.492 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:31:35.492 15:32:39 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:31:35.492 15:32:39 -- nvmf/common.sh@7 -- # uname -s 00:31:35.492 15:32:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:35.492 15:32:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:35.492 15:32:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:35.492 15:32:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:35.492 15:32:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:35.492 15:32:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:35.492 15:32:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:35.492 15:32:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:35.492 15:32:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:35.492 15:32:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:35.492 15:32:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:31:35.492 15:32:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:31:35.492 15:32:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:35.492 15:32:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:35.492 15:32:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:35.492 15:32:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:35.492 15:32:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:31:35.492 15:32:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:35.492 15:32:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:35.492 15:32:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:35.492 15:32:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.492 15:32:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.492 15:32:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.492 15:32:39 -- paths/export.sh@5 -- # export PATH 00:31:35.492 15:32:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.492 15:32:39 -- nvmf/common.sh@47 -- # : 0 00:31:35.492 15:32:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:35.492 15:32:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:35.492 15:32:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:35.492 15:32:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:35.492 15:32:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:35.492 15:32:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:35.492 15:32:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:35.492 15:32:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:35.492 15:32:39 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:31:35.492 15:32:39 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:35.492 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:35.492 15:32:39 -- host/discovery.sh@13 -- # exit 0 00:31:35.492 00:31:35.492 real 0m0.130s 00:31:35.492 user 0m0.056s 00:31:35.492 sys 0m0.085s 00:31:35.492 15:32:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:35.492 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:35.492 ************************************ 00:31:35.492 END TEST nvmf_discovery 00:31:35.492 ************************************ 00:31:35.492 15:32:39 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:35.492 15:32:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:35.492 15:32:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:35.492 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:35.753 ************************************ 00:31:35.753 START TEST nvmf_discovery_remove_ifc 00:31:35.753 ************************************ 00:31:35.753 15:32:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:35.753 * Looking for test storage... 00:31:35.753 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:31:35.753 15:32:39 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:31:35.753 15:32:39 -- nvmf/common.sh@7 -- # uname -s 00:31:35.753 15:32:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:35.753 15:32:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:35.753 15:32:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:35.753 15:32:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:35.753 15:32:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:35.753 15:32:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:35.753 15:32:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:35.753 15:32:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:35.753 15:32:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:35.753 15:32:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:35.753 15:32:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:31:35.753 15:32:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:31:35.753 15:32:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:35.753 15:32:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:35.753 15:32:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:35.753 15:32:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:35.753 15:32:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:31:35.753 15:32:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:35.753 15:32:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:35.753 15:32:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:35.753 15:32:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.753 15:32:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.753 15:32:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.753 15:32:39 -- paths/export.sh@5 -- # export PATH 00:31:35.753 15:32:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:35.753 15:32:39 -- nvmf/common.sh@47 -- # : 0 00:31:35.753 15:32:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:35.753 15:32:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:35.753 15:32:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:35.753 15:32:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:35.753 15:32:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:35.753 15:32:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:35.753 15:32:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:35.753 15:32:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:35.753 15:32:39 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:31:35.753 15:32:39 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:35.753 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:35.753 15:32:39 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:31:35.753 00:31:35.753 real 0m0.140s 00:31:35.753 user 0m0.058s 00:31:35.753 sys 0m0.091s 00:31:35.753 15:32:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:35.753 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:35.753 ************************************ 00:31:35.753 END TEST nvmf_discovery_remove_ifc 00:31:35.753 ************************************ 00:31:36.013 15:32:39 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:36.013 15:32:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:36.013 15:32:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:36.013 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:36.013 ************************************ 00:31:36.013 START TEST nvmf_identify_kernel_target 00:31:36.013 ************************************ 00:31:36.013 15:32:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:36.273 * Looking for test storage... 00:31:36.273 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:31:36.273 15:32:39 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:31:36.273 15:32:39 -- nvmf/common.sh@7 -- # uname -s 00:31:36.273 15:32:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:36.273 15:32:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:36.273 15:32:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:36.273 15:32:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:36.273 15:32:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:36.273 15:32:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:36.273 15:32:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:36.273 15:32:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:36.273 15:32:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:36.273 15:32:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:36.273 15:32:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:31:36.273 15:32:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:31:36.273 15:32:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:36.273 15:32:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:36.273 15:32:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:36.273 15:32:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:36.273 15:32:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:31:36.273 15:32:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:36.273 15:32:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:36.273 15:32:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:36.273 15:32:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:36.273 15:32:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:36.273 15:32:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:36.273 15:32:39 -- paths/export.sh@5 -- # export PATH 00:31:36.273 15:32:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:36.273 15:32:39 -- nvmf/common.sh@47 -- # : 0 00:31:36.273 15:32:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:36.273 15:32:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:36.273 15:32:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:36.273 15:32:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:36.273 15:32:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:36.273 15:32:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:36.273 15:32:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:36.273 15:32:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:36.273 15:32:39 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:31:36.273 15:32:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:36.273 15:32:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:36.273 15:32:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:36.273 15:32:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:36.273 15:32:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:36.273 15:32:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:36.273 15:32:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:36.273 15:32:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:36.273 15:32:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:36.273 15:32:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:36.273 15:32:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:36.273 15:32:39 -- common/autotest_common.sh@10 -- # set +x 00:31:44.403 15:32:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:44.403 15:32:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:44.403 15:32:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:44.403 15:32:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:44.403 15:32:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:44.403 15:32:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:44.403 15:32:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:44.403 15:32:46 -- nvmf/common.sh@295 -- # net_devs=() 00:31:44.403 15:32:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:44.403 15:32:46 -- nvmf/common.sh@296 -- # e810=() 00:31:44.403 15:32:46 -- nvmf/common.sh@296 -- # local -ga e810 00:31:44.403 15:32:46 -- nvmf/common.sh@297 -- # x722=() 00:31:44.403 15:32:46 -- nvmf/common.sh@297 -- # local -ga x722 00:31:44.403 15:32:46 -- nvmf/common.sh@298 -- # mlx=() 00:31:44.403 15:32:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:44.403 15:32:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:44.403 15:32:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:44.403 15:32:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:44.403 15:32:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:44.403 15:32:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:44.403 15:32:46 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:31:44.403 15:32:46 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:31:44.403 15:32:46 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:31:44.403 15:32:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:44.403 15:32:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:44.403 15:32:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:31:44.403 Found 0000:18:00.0 (0x8086 - 0x1592) 00:31:44.404 15:32:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:44.404 15:32:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:31:44.404 Found 0000:18:00.1 (0x8086 - 0x1592) 00:31:44.404 15:32:46 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:44.404 15:32:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@377 -- # modinfo irdma 00:31:44.404 15:32:46 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:31:44.404 15:32:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:44.404 15:32:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:44.404 15:32:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:31:44.404 Found net devices under 0000:18:00.0: cvl_0_0 00:31:44.404 15:32:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:44.404 15:32:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:44.404 15:32:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:44.404 15:32:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:31:44.404 Found net devices under 0000:18:00.1: cvl_0_1 00:31:44.404 15:32:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:44.404 15:32:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:44.404 15:32:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:44.404 15:32:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:44.404 15:32:46 -- nvmf/common.sh@58 -- # uname 00:31:44.404 15:32:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:44.404 15:32:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:44.404 15:32:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:44.404 15:32:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:44.404 15:32:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:44.404 15:32:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:44.404 15:32:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:44.404 15:32:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:44.404 15:32:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:44.404 15:32:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:44.404 15:32:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:44.404 15:32:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:44.404 15:32:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:44.404 15:32:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:44.404 15:32:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:44.404 15:32:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:44.404 15:32:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:31:44.404 15:32:46 -- nvmf/common.sh@105 -- # continue 2 00:31:44.404 15:32:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:46 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:31:44.404 15:32:46 -- nvmf/common.sh@105 -- # continue 2 00:31:44.404 15:32:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:44.404 15:32:46 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:31:44.404 15:32:46 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:31:44.404 15:32:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:31:44.404 15:32:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.404 15:32:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.404 15:32:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:44.404 15:32:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:44.404 15:32:46 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:31:44.404 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:31:44.404 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:31:44.404 altname enp24s0f0np0 00:31:44.404 altname ens785f0np0 00:31:44.404 inet 192.168.100.8/24 scope global cvl_0_0 00:31:44.404 valid_lft forever preferred_lft forever 00:31:44.404 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:31:44.404 valid_lft forever preferred_lft forever 00:31:44.404 15:32:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:44.404 15:32:47 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.404 15:32:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:44.404 15:32:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:44.404 15:32:47 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:31:44.404 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:31:44.404 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:31:44.404 altname enp24s0f1np1 00:31:44.404 altname ens785f1np1 00:31:44.404 inet 192.168.100.9/24 scope global cvl_0_1 00:31:44.404 valid_lft forever preferred_lft forever 00:31:44.404 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:31:44.404 valid_lft forever preferred_lft forever 00:31:44.404 15:32:47 -- nvmf/common.sh@411 -- # return 0 00:31:44.404 15:32:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:44.404 15:32:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:44.404 15:32:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:44.404 15:32:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:44.404 15:32:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:44.404 15:32:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:44.404 15:32:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:44.404 15:32:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:44.404 15:32:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:44.404 15:32:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:44.404 15:32:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.404 15:32:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:31:44.404 15:32:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:47 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:31:44.404 15:32:47 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:31:44.404 15:32:47 -- nvmf/common.sh@105 -- # continue 2 00:31:44.404 15:32:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:44.404 15:32:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:44.404 15:32:47 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:31:44.404 15:32:47 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@105 -- # continue 2 00:31:44.404 15:32:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:44.404 15:32:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:31:44.404 15:32:47 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.404 15:32:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:44.404 15:32:47 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:44.404 15:32:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:44.404 15:32:47 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:44.404 192.168.100.9' 00:31:44.404 15:32:47 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:44.404 192.168.100.9' 00:31:44.404 15:32:47 -- nvmf/common.sh@446 -- # head -n 1 00:31:44.404 15:32:47 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:44.404 15:32:47 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:44.404 192.168.100.9' 00:31:44.404 15:32:47 -- nvmf/common.sh@447 -- # tail -n +2 00:31:44.404 15:32:47 -- nvmf/common.sh@447 -- # head -n 1 00:31:44.404 15:32:47 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:44.404 15:32:47 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:44.404 15:32:47 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:44.404 15:32:47 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:44.404 15:32:47 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:44.404 15:32:47 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:44.405 15:32:47 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:31:44.405 15:32:47 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:31:44.405 15:32:47 -- nvmf/common.sh@717 -- # local ip 00:31:44.405 15:32:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:44.405 15:32:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:44.405 15:32:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:44.405 15:32:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:44.405 15:32:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:44.405 15:32:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:44.405 15:32:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:44.405 15:32:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:44.405 15:32:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:44.405 15:32:47 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:31:44.405 15:32:47 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:31:44.405 15:32:47 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:31:44.405 15:32:47 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:31:44.405 15:32:47 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:44.405 15:32:47 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:44.405 15:32:47 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:31:44.405 15:32:47 -- nvmf/common.sh@628 -- # local block nvme 00:31:44.405 15:32:47 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:31:44.405 15:32:47 -- nvmf/common.sh@631 -- # modprobe nvmet 00:31:44.405 15:32:47 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:31:44.405 15:32:47 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:31:46.940 Waiting for block devices as requested 00:31:46.940 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:31:46.940 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:46.940 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:46.940 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:47.200 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:47.200 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:47.200 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:47.200 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:47.467 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:47.467 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:47.467 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:47.726 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:47.726 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:47.726 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:47.984 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:47.984 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:47.984 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:48.286 15:32:51 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:31:48.286 15:32:51 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:31:48.286 15:32:51 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:31:48.286 15:32:51 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:31:48.286 15:32:51 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:31:48.286 15:32:51 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:31:48.286 15:32:51 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:31:48.286 15:32:51 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:31:48.286 15:32:51 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:31:48.286 No valid GPT data, bailing 00:31:48.286 15:32:51 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:31:48.286 15:32:51 -- scripts/common.sh@391 -- # pt= 00:31:48.286 15:32:51 -- scripts/common.sh@392 -- # return 1 00:31:48.286 15:32:51 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:31:48.286 15:32:51 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:31:48.286 15:32:51 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:48.286 15:32:51 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:48.286 15:32:51 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:31:48.286 15:32:52 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:31:48.286 15:32:52 -- nvmf/common.sh@656 -- # echo 1 00:31:48.286 15:32:52 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:31:48.286 15:32:52 -- nvmf/common.sh@658 -- # echo 1 00:31:48.286 15:32:52 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:31:48.286 15:32:52 -- nvmf/common.sh@661 -- # echo rdma 00:31:48.286 15:32:52 -- nvmf/common.sh@662 -- # echo 4420 00:31:48.286 15:32:52 -- nvmf/common.sh@663 -- # echo ipv4 00:31:48.286 15:32:52 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:31:48.286 15:32:52 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -a 192.168.100.8 -t rdma -s 4420 00:31:48.286 00:31:48.286 Discovery Log Number of Records 2, Generation counter 2 00:31:48.286 =====Discovery Log Entry 0====== 00:31:48.286 trtype: rdma 00:31:48.286 adrfam: ipv4 00:31:48.286 subtype: current discovery subsystem 00:31:48.286 treq: not specified, sq flow control disable supported 00:31:48.286 portid: 1 00:31:48.286 trsvcid: 4420 00:31:48.286 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:31:48.286 traddr: 192.168.100.8 00:31:48.286 eflags: none 00:31:48.286 rdma_prtype: not specified 00:31:48.286 rdma_qptype: connected 00:31:48.286 rdma_cms: rdma-cm 00:31:48.286 rdma_pkey: 0x0000 00:31:48.286 =====Discovery Log Entry 1====== 00:31:48.286 trtype: rdma 00:31:48.286 adrfam: ipv4 00:31:48.286 subtype: nvme subsystem 00:31:48.286 treq: not specified, sq flow control disable supported 00:31:48.286 portid: 1 00:31:48.286 trsvcid: 4420 00:31:48.286 subnqn: nqn.2016-06.io.spdk:testnqn 00:31:48.286 traddr: 192.168.100.8 00:31:48.286 eflags: none 00:31:48.286 rdma_prtype: not specified 00:31:48.286 rdma_qptype: connected 00:31:48.286 rdma_cms: rdma-cm 00:31:48.286 rdma_pkey: 0x0000 00:31:48.286 15:32:52 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:31:48.287 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:31:48.287 EAL: No free 2048 kB hugepages reported on node 1 00:31:48.555 ===================================================== 00:31:48.555 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:31:48.555 ===================================================== 00:31:48.555 Controller Capabilities/Features 00:31:48.555 ================================ 00:31:48.555 Vendor ID: 0000 00:31:48.555 Subsystem Vendor ID: 0000 00:31:48.555 Serial Number: 87510a182fe1d04fd432 00:31:48.555 Model Number: Linux 00:31:48.555 Firmware Version: 6.7.0-68 00:31:48.555 Recommended Arb Burst: 0 00:31:48.555 IEEE OUI Identifier: 00 00 00 00:31:48.555 Multi-path I/O 00:31:48.555 May have multiple subsystem ports: No 00:31:48.555 May have multiple controllers: No 00:31:48.555 Associated with SR-IOV VF: No 00:31:48.555 Max Data Transfer Size: Unlimited 00:31:48.555 Max Number of Namespaces: 0 00:31:48.555 Max Number of I/O Queues: 1024 00:31:48.555 NVMe Specification Version (VS): 1.3 00:31:48.555 NVMe Specification Version (Identify): 1.3 00:31:48.555 Maximum Queue Entries: 128 00:31:48.555 Contiguous Queues Required: No 00:31:48.555 Arbitration Mechanisms Supported 00:31:48.555 Weighted Round Robin: Not Supported 00:31:48.555 Vendor Specific: Not Supported 00:31:48.555 Reset Timeout: 7500 ms 00:31:48.555 Doorbell Stride: 4 bytes 00:31:48.555 NVM Subsystem Reset: Not Supported 00:31:48.555 Command Sets Supported 00:31:48.555 NVM Command Set: Supported 00:31:48.555 Boot Partition: Not Supported 00:31:48.555 Memory Page Size Minimum: 4096 bytes 00:31:48.555 Memory Page Size Maximum: 4096 bytes 00:31:48.555 Persistent Memory Region: Not Supported 00:31:48.555 Optional Asynchronous Events Supported 00:31:48.555 Namespace Attribute Notices: Not Supported 00:31:48.555 Firmware Activation Notices: Not Supported 00:31:48.555 ANA Change Notices: Not Supported 00:31:48.555 PLE Aggregate Log Change Notices: Not Supported 00:31:48.555 LBA Status Info Alert Notices: Not Supported 00:31:48.555 EGE Aggregate Log Change Notices: Not Supported 00:31:48.555 Normal NVM Subsystem Shutdown event: Not Supported 00:31:48.555 Zone Descriptor Change Notices: Not Supported 00:31:48.555 Discovery Log Change Notices: Supported 00:31:48.555 Controller Attributes 00:31:48.555 128-bit Host Identifier: Not Supported 00:31:48.555 Non-Operational Permissive Mode: Not Supported 00:31:48.555 NVM Sets: Not Supported 00:31:48.555 Read Recovery Levels: Not Supported 00:31:48.555 Endurance Groups: Not Supported 00:31:48.555 Predictable Latency Mode: Not Supported 00:31:48.555 Traffic Based Keep ALive: Not Supported 00:31:48.555 Namespace Granularity: Not Supported 00:31:48.555 SQ Associations: Not Supported 00:31:48.555 UUID List: Not Supported 00:31:48.555 Multi-Domain Subsystem: Not Supported 00:31:48.555 Fixed Capacity Management: Not Supported 00:31:48.555 Variable Capacity Management: Not Supported 00:31:48.555 Delete Endurance Group: Not Supported 00:31:48.555 Delete NVM Set: Not Supported 00:31:48.555 Extended LBA Formats Supported: Not Supported 00:31:48.555 Flexible Data Placement Supported: Not Supported 00:31:48.555 00:31:48.555 Controller Memory Buffer Support 00:31:48.555 ================================ 00:31:48.555 Supported: No 00:31:48.555 00:31:48.555 Persistent Memory Region Support 00:31:48.555 ================================ 00:31:48.555 Supported: No 00:31:48.555 00:31:48.555 Admin Command Set Attributes 00:31:48.555 ============================ 00:31:48.555 Security Send/Receive: Not Supported 00:31:48.555 Format NVM: Not Supported 00:31:48.555 Firmware Activate/Download: Not Supported 00:31:48.555 Namespace Management: Not Supported 00:31:48.555 Device Self-Test: Not Supported 00:31:48.555 Directives: Not Supported 00:31:48.555 NVMe-MI: Not Supported 00:31:48.555 Virtualization Management: Not Supported 00:31:48.555 Doorbell Buffer Config: Not Supported 00:31:48.555 Get LBA Status Capability: Not Supported 00:31:48.555 Command & Feature Lockdown Capability: Not Supported 00:31:48.555 Abort Command Limit: 1 00:31:48.555 Async Event Request Limit: 1 00:31:48.555 Number of Firmware Slots: N/A 00:31:48.555 Firmware Slot 1 Read-Only: N/A 00:31:48.555 Firmware Activation Without Reset: N/A 00:31:48.555 Multiple Update Detection Support: N/A 00:31:48.555 Firmware Update Granularity: No Information Provided 00:31:48.555 Per-Namespace SMART Log: No 00:31:48.555 Asymmetric Namespace Access Log Page: Not Supported 00:31:48.555 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:31:48.555 Command Effects Log Page: Not Supported 00:31:48.555 Get Log Page Extended Data: Supported 00:31:48.555 Telemetry Log Pages: Not Supported 00:31:48.555 Persistent Event Log Pages: Not Supported 00:31:48.555 Supported Log Pages Log Page: May Support 00:31:48.555 Commands Supported & Effects Log Page: Not Supported 00:31:48.555 Feature Identifiers & Effects Log Page:May Support 00:31:48.555 NVMe-MI Commands & Effects Log Page: May Support 00:31:48.555 Data Area 4 for Telemetry Log: Not Supported 00:31:48.555 Error Log Page Entries Supported: 1 00:31:48.555 Keep Alive: Not Supported 00:31:48.555 00:31:48.555 NVM Command Set Attributes 00:31:48.555 ========================== 00:31:48.555 Submission Queue Entry Size 00:31:48.555 Max: 1 00:31:48.555 Min: 1 00:31:48.555 Completion Queue Entry Size 00:31:48.555 Max: 1 00:31:48.555 Min: 1 00:31:48.555 Number of Namespaces: 0 00:31:48.555 Compare Command: Not Supported 00:31:48.555 Write Uncorrectable Command: Not Supported 00:31:48.555 Dataset Management Command: Not Supported 00:31:48.555 Write Zeroes Command: Not Supported 00:31:48.555 Set Features Save Field: Not Supported 00:31:48.555 Reservations: Not Supported 00:31:48.555 Timestamp: Not Supported 00:31:48.555 Copy: Not Supported 00:31:48.555 Volatile Write Cache: Not Present 00:31:48.555 Atomic Write Unit (Normal): 1 00:31:48.555 Atomic Write Unit (PFail): 1 00:31:48.555 Atomic Compare & Write Unit: 1 00:31:48.555 Fused Compare & Write: Not Supported 00:31:48.555 Scatter-Gather List 00:31:48.555 SGL Command Set: Supported 00:31:48.555 SGL Keyed: Supported 00:31:48.555 SGL Bit Bucket Descriptor: Not Supported 00:31:48.556 SGL Metadata Pointer: Not Supported 00:31:48.556 Oversized SGL: Not Supported 00:31:48.556 SGL Metadata Address: Not Supported 00:31:48.556 SGL Offset: Supported 00:31:48.556 Transport SGL Data Block: Not Supported 00:31:48.556 Replay Protected Memory Block: Not Supported 00:31:48.556 00:31:48.556 Firmware Slot Information 00:31:48.556 ========================= 00:31:48.556 Active slot: 0 00:31:48.556 00:31:48.556 00:31:48.556 Error Log 00:31:48.556 ========= 00:31:48.556 00:31:48.556 Active Namespaces 00:31:48.556 ================= 00:31:48.556 Discovery Log Page 00:31:48.556 ================== 00:31:48.556 Generation Counter: 2 00:31:48.556 Number of Records: 2 00:31:48.556 Record Format: 0 00:31:48.556 00:31:48.556 Discovery Log Entry 0 00:31:48.556 ---------------------- 00:31:48.556 Transport Type: 1 (RDMA) 00:31:48.556 Address Family: 1 (IPv4) 00:31:48.556 Subsystem Type: 3 (Current Discovery Subsystem) 00:31:48.556 Entry Flags: 00:31:48.556 Duplicate Returned Information: 0 00:31:48.556 Explicit Persistent Connection Support for Discovery: 0 00:31:48.556 Transport Requirements: 00:31:48.556 Secure Channel: Not Specified 00:31:48.556 Port ID: 1 (0x0001) 00:31:48.556 Controller ID: 65535 (0xffff) 00:31:48.556 Admin Max SQ Size: 32 00:31:48.556 Transport Service Identifier: 4420 00:31:48.556 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:31:48.556 Transport Address: 192.168.100.8 00:31:48.556 Transport Specific Address Subtype - RDMA 00:31:48.556 RDMA QP Service Type: 1 (Reliable Connected) 00:31:48.556 RDMA Provider Type: 1 (No provider specified) 00:31:48.556 RDMA CM Service: 1 (RDMA_CM) 00:31:48.556 Discovery Log Entry 1 00:31:48.556 ---------------------- 00:31:48.556 Transport Type: 1 (RDMA) 00:31:48.556 Address Family: 1 (IPv4) 00:31:48.556 Subsystem Type: 2 (NVM Subsystem) 00:31:48.556 Entry Flags: 00:31:48.556 Duplicate Returned Information: 0 00:31:48.556 Explicit Persistent Connection Support for Discovery: 0 00:31:48.556 Transport Requirements: 00:31:48.556 Secure Channel: Not Specified 00:31:48.556 Port ID: 1 (0x0001) 00:31:48.556 Controller ID: 65535 (0xffff) 00:31:48.556 Admin Max SQ Size: 32 00:31:48.556 Transport Service Identifier: 4420 00:31:48.556 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:31:48.556 Transport Address: 192.168.100.8 00:31:48.556 Transport Specific Address Subtype - RDMA 00:31:48.556 RDMA QP Service Type: 1 (Reliable Connected) 00:31:48.556 RDMA Provider Type: 1 (No provider specified) 00:31:48.556 RDMA CM Service: 1 (RDMA_CM) 00:31:48.556 15:32:52 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:31:48.556 EAL: No free 2048 kB hugepages reported on node 1 00:31:48.556 get_feature(0x01) failed 00:31:48.556 get_feature(0x02) failed 00:31:48.556 get_feature(0x04) failed 00:31:48.556 ===================================================== 00:31:48.556 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:31:48.556 ===================================================== 00:31:48.556 Controller Capabilities/Features 00:31:48.556 ================================ 00:31:48.556 Vendor ID: 0000 00:31:48.556 Subsystem Vendor ID: 0000 00:31:48.556 Serial Number: 9735208075c95291f578 00:31:48.556 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:31:48.556 Firmware Version: 6.7.0-68 00:31:48.556 Recommended Arb Burst: 6 00:31:48.556 IEEE OUI Identifier: 00 00 00 00:31:48.556 Multi-path I/O 00:31:48.556 May have multiple subsystem ports: Yes 00:31:48.556 May have multiple controllers: Yes 00:31:48.556 Associated with SR-IOV VF: No 00:31:48.556 Max Data Transfer Size: 1048576 00:31:48.556 Max Number of Namespaces: 1024 00:31:48.556 Max Number of I/O Queues: 128 00:31:48.556 NVMe Specification Version (VS): 1.3 00:31:48.556 NVMe Specification Version (Identify): 1.3 00:31:48.556 Maximum Queue Entries: 128 00:31:48.556 Contiguous Queues Required: No 00:31:48.556 Arbitration Mechanisms Supported 00:31:48.556 Weighted Round Robin: Not Supported 00:31:48.556 Vendor Specific: Not Supported 00:31:48.556 Reset Timeout: 7500 ms 00:31:48.556 Doorbell Stride: 4 bytes 00:31:48.556 NVM Subsystem Reset: Not Supported 00:31:48.556 Command Sets Supported 00:31:48.556 NVM Command Set: Supported 00:31:48.556 Boot Partition: Not Supported 00:31:48.556 Memory Page Size Minimum: 4096 bytes 00:31:48.556 Memory Page Size Maximum: 4096 bytes 00:31:48.556 Persistent Memory Region: Not Supported 00:31:48.556 Optional Asynchronous Events Supported 00:31:48.556 Namespace Attribute Notices: Supported 00:31:48.556 Firmware Activation Notices: Not Supported 00:31:48.556 ANA Change Notices: Supported 00:31:48.556 PLE Aggregate Log Change Notices: Not Supported 00:31:48.556 LBA Status Info Alert Notices: Not Supported 00:31:48.556 EGE Aggregate Log Change Notices: Not Supported 00:31:48.556 Normal NVM Subsystem Shutdown event: Not Supported 00:31:48.556 Zone Descriptor Change Notices: Not Supported 00:31:48.556 Discovery Log Change Notices: Not Supported 00:31:48.556 Controller Attributes 00:31:48.556 128-bit Host Identifier: Supported 00:31:48.556 Non-Operational Permissive Mode: Not Supported 00:31:48.556 NVM Sets: Not Supported 00:31:48.556 Read Recovery Levels: Not Supported 00:31:48.556 Endurance Groups: Not Supported 00:31:48.556 Predictable Latency Mode: Not Supported 00:31:48.556 Traffic Based Keep ALive: Supported 00:31:48.556 Namespace Granularity: Not Supported 00:31:48.556 SQ Associations: Not Supported 00:31:48.556 UUID List: Not Supported 00:31:48.556 Multi-Domain Subsystem: Not Supported 00:31:48.556 Fixed Capacity Management: Not Supported 00:31:48.556 Variable Capacity Management: Not Supported 00:31:48.556 Delete Endurance Group: Not Supported 00:31:48.556 Delete NVM Set: Not Supported 00:31:48.556 Extended LBA Formats Supported: Not Supported 00:31:48.556 Flexible Data Placement Supported: Not Supported 00:31:48.556 00:31:48.556 Controller Memory Buffer Support 00:31:48.556 ================================ 00:31:48.556 Supported: No 00:31:48.556 00:31:48.556 Persistent Memory Region Support 00:31:48.556 ================================ 00:31:48.556 Supported: No 00:31:48.556 00:31:48.556 Admin Command Set Attributes 00:31:48.556 ============================ 00:31:48.556 Security Send/Receive: Not Supported 00:31:48.556 Format NVM: Not Supported 00:31:48.556 Firmware Activate/Download: Not Supported 00:31:48.556 Namespace Management: Not Supported 00:31:48.556 Device Self-Test: Not Supported 00:31:48.556 Directives: Not Supported 00:31:48.556 NVMe-MI: Not Supported 00:31:48.556 Virtualization Management: Not Supported 00:31:48.556 Doorbell Buffer Config: Not Supported 00:31:48.556 Get LBA Status Capability: Not Supported 00:31:48.556 Command & Feature Lockdown Capability: Not Supported 00:31:48.556 Abort Command Limit: 4 00:31:48.556 Async Event Request Limit: 4 00:31:48.556 Number of Firmware Slots: N/A 00:31:48.556 Firmware Slot 1 Read-Only: N/A 00:31:48.556 Firmware Activation Without Reset: N/A 00:31:48.556 Multiple Update Detection Support: N/A 00:31:48.556 Firmware Update Granularity: No Information Provided 00:31:48.556 Per-Namespace SMART Log: Yes 00:31:48.556 Asymmetric Namespace Access Log Page: Supported 00:31:48.556 ANA Transition Time : 10 sec 00:31:48.556 00:31:48.556 Asymmetric Namespace Access Capabilities 00:31:48.556 ANA Optimized State : Supported 00:31:48.556 ANA Non-Optimized State : Supported 00:31:48.556 ANA Inaccessible State : Supported 00:31:48.556 ANA Persistent Loss State : Supported 00:31:48.556 ANA Change State : Supported 00:31:48.556 ANAGRPID is not changed : No 00:31:48.556 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:31:48.556 00:31:48.556 ANA Group Identifier Maximum : 128 00:31:48.556 Number of ANA Group Identifiers : 128 00:31:48.556 Max Number of Allowed Namespaces : 1024 00:31:48.556 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:31:48.556 Command Effects Log Page: Supported 00:31:48.556 Get Log Page Extended Data: Supported 00:31:48.556 Telemetry Log Pages: Not Supported 00:31:48.556 Persistent Event Log Pages: Not Supported 00:31:48.556 Supported Log Pages Log Page: May Support 00:31:48.556 Commands Supported & Effects Log Page: Not Supported 00:31:48.556 Feature Identifiers & Effects Log Page:May Support 00:31:48.556 NVMe-MI Commands & Effects Log Page: May Support 00:31:48.556 Data Area 4 for Telemetry Log: Not Supported 00:31:48.556 Error Log Page Entries Supported: 128 00:31:48.556 Keep Alive: Supported 00:31:48.556 Keep Alive Granularity: 1000 ms 00:31:48.556 00:31:48.556 NVM Command Set Attributes 00:31:48.556 ========================== 00:31:48.556 Submission Queue Entry Size 00:31:48.557 Max: 64 00:31:48.557 Min: 64 00:31:48.557 Completion Queue Entry Size 00:31:48.557 Max: 16 00:31:48.557 Min: 16 00:31:48.557 Number of Namespaces: 1024 00:31:48.557 Compare Command: Not Supported 00:31:48.557 Write Uncorrectable Command: Not Supported 00:31:48.557 Dataset Management Command: Supported 00:31:48.557 Write Zeroes Command: Supported 00:31:48.557 Set Features Save Field: Not Supported 00:31:48.557 Reservations: Not Supported 00:31:48.557 Timestamp: Not Supported 00:31:48.557 Copy: Not Supported 00:31:48.557 Volatile Write Cache: Present 00:31:48.557 Atomic Write Unit (Normal): 1 00:31:48.557 Atomic Write Unit (PFail): 1 00:31:48.557 Atomic Compare & Write Unit: 1 00:31:48.557 Fused Compare & Write: Not Supported 00:31:48.557 Scatter-Gather List 00:31:48.557 SGL Command Set: Supported 00:31:48.557 SGL Keyed: Supported 00:31:48.557 SGL Bit Bucket Descriptor: Not Supported 00:31:48.557 SGL Metadata Pointer: Not Supported 00:31:48.557 Oversized SGL: Not Supported 00:31:48.557 SGL Metadata Address: Not Supported 00:31:48.557 SGL Offset: Supported 00:31:48.557 Transport SGL Data Block: Not Supported 00:31:48.557 Replay Protected Memory Block: Not Supported 00:31:48.557 00:31:48.557 Firmware Slot Information 00:31:48.557 ========================= 00:31:48.557 Active slot: 0 00:31:48.557 00:31:48.557 Asymmetric Namespace Access 00:31:48.557 =========================== 00:31:48.557 Change Count : 0 00:31:48.557 Number of ANA Group Descriptors : 1 00:31:48.557 ANA Group Descriptor : 0 00:31:48.557 ANA Group ID : 1 00:31:48.557 Number of NSID Values : 1 00:31:48.557 Change Count : 0 00:31:48.557 ANA State : 1 00:31:48.557 Namespace Identifier : 1 00:31:48.557 00:31:48.557 Commands Supported and Effects 00:31:48.557 ============================== 00:31:48.557 Admin Commands 00:31:48.557 -------------- 00:31:48.557 Get Log Page (02h): Supported 00:31:48.557 Identify (06h): Supported 00:31:48.557 Abort (08h): Supported 00:31:48.557 Set Features (09h): Supported 00:31:48.557 Get Features (0Ah): Supported 00:31:48.557 Asynchronous Event Request (0Ch): Supported 00:31:48.557 Keep Alive (18h): Supported 00:31:48.557 I/O Commands 00:31:48.557 ------------ 00:31:48.557 Flush (00h): Supported 00:31:48.557 Write (01h): Supported LBA-Change 00:31:48.557 Read (02h): Supported 00:31:48.557 Write Zeroes (08h): Supported LBA-Change 00:31:48.557 Dataset Management (09h): Supported 00:31:48.557 00:31:48.557 Error Log 00:31:48.557 ========= 00:31:48.557 Entry: 0 00:31:48.557 Error Count: 0x3 00:31:48.557 Submission Queue Id: 0x0 00:31:48.557 Command Id: 0x5 00:31:48.557 Phase Bit: 0 00:31:48.557 Status Code: 0x2 00:31:48.557 Status Code Type: 0x0 00:31:48.557 Do Not Retry: 1 00:31:48.557 Error Location: 0x28 00:31:48.557 LBA: 0x0 00:31:48.557 Namespace: 0x0 00:31:48.557 Vendor Log Page: 0x0 00:31:48.557 ----------- 00:31:48.557 Entry: 1 00:31:48.557 Error Count: 0x2 00:31:48.557 Submission Queue Id: 0x0 00:31:48.557 Command Id: 0x5 00:31:48.557 Phase Bit: 0 00:31:48.557 Status Code: 0x2 00:31:48.557 Status Code Type: 0x0 00:31:48.557 Do Not Retry: 1 00:31:48.557 Error Location: 0x28 00:31:48.557 LBA: 0x0 00:31:48.557 Namespace: 0x0 00:31:48.557 Vendor Log Page: 0x0 00:31:48.557 ----------- 00:31:48.557 Entry: 2 00:31:48.557 Error Count: 0x1 00:31:48.557 Submission Queue Id: 0x0 00:31:48.557 Command Id: 0x0 00:31:48.557 Phase Bit: 0 00:31:48.557 Status Code: 0x2 00:31:48.557 Status Code Type: 0x0 00:31:48.557 Do Not Retry: 1 00:31:48.557 Error Location: 0x28 00:31:48.557 LBA: 0x0 00:31:48.557 Namespace: 0x0 00:31:48.557 Vendor Log Page: 0x0 00:31:48.557 00:31:48.557 Number of Queues 00:31:48.557 ================ 00:31:48.557 Number of I/O Submission Queues: 128 00:31:48.557 Number of I/O Completion Queues: 128 00:31:48.557 00:31:48.557 ZNS Specific Controller Data 00:31:48.557 ============================ 00:31:48.557 Zone Append Size Limit: 0 00:31:48.557 00:31:48.557 00:31:48.557 Active Namespaces 00:31:48.557 ================= 00:31:48.557 get_feature(0x05) failed 00:31:48.557 Namespace ID:1 00:31:48.557 Command Set Identifier: NVM (00h) 00:31:48.557 Deallocate: Supported 00:31:48.557 Deallocated/Unwritten Error: Not Supported 00:31:48.557 Deallocated Read Value: Unknown 00:31:48.557 Deallocate in Write Zeroes: Not Supported 00:31:48.557 Deallocated Guard Field: 0xFFFF 00:31:48.557 Flush: Supported 00:31:48.557 Reservation: Not Supported 00:31:48.557 Namespace Sharing Capabilities: Multiple Controllers 00:31:48.557 Size (in LBAs): 7814037168 (3726GiB) 00:31:48.557 Capacity (in LBAs): 7814037168 (3726GiB) 00:31:48.557 Utilization (in LBAs): 7814037168 (3726GiB) 00:31:48.557 UUID: 59860a89-5cb6-4f8c-b0b3-2e150c01ca8e 00:31:48.557 Thin Provisioning: Not Supported 00:31:48.557 Per-NS Atomic Units: Yes 00:31:48.557 Atomic Boundary Size (Normal): 0 00:31:48.557 Atomic Boundary Size (PFail): 0 00:31:48.557 Atomic Boundary Offset: 0 00:31:48.557 NGUID/EUI64 Never Reused: No 00:31:48.557 ANA group ID: 1 00:31:48.557 Namespace Write Protected: No 00:31:48.557 Number of LBA Formats: 1 00:31:48.557 Current LBA Format: LBA Format #00 00:31:48.557 LBA Format #00: Data Size: 512 Metadata Size: 0 00:31:48.557 00:31:48.557 15:32:52 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:31:48.557 15:32:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:48.557 15:32:52 -- nvmf/common.sh@117 -- # sync 00:31:48.557 15:32:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:48.557 15:32:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:48.557 15:32:52 -- nvmf/common.sh@120 -- # set +e 00:31:48.557 15:32:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:48.557 15:32:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:48.557 rmmod nvme_rdma 00:31:48.557 rmmod nvme_fabrics 00:31:48.557 15:32:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:48.557 15:32:52 -- nvmf/common.sh@124 -- # set -e 00:31:48.557 15:32:52 -- nvmf/common.sh@125 -- # return 0 00:31:48.557 15:32:52 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:31:48.557 15:32:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:48.557 15:32:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:48.557 15:32:52 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:31:48.557 15:32:52 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:31:48.557 15:32:52 -- nvmf/common.sh@675 -- # echo 0 00:31:48.557 15:32:52 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:48.557 15:32:52 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:48.557 15:32:52 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:31:48.557 15:32:52 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:48.557 15:32:52 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:31:48.557 15:32:52 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:31:48.905 15:32:52 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:31:52.196 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:52.196 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:55.487 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:31:55.487 00:31:55.487 real 0m19.328s 00:31:55.487 user 0m4.950s 00:31:55.487 sys 0m10.709s 00:31:55.487 15:32:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:55.487 15:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:55.487 ************************************ 00:31:55.487 END TEST nvmf_identify_kernel_target 00:31:55.487 ************************************ 00:31:55.487 15:32:59 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:55.487 15:32:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:55.487 15:32:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:55.487 15:32:59 -- common/autotest_common.sh@10 -- # set +x 00:31:55.487 ************************************ 00:31:55.487 START TEST nvmf_auth 00:31:55.487 ************************************ 00:31:55.487 15:32:59 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:55.746 * Looking for test storage... 00:31:55.746 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:31:55.746 15:32:59 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:31:55.746 15:32:59 -- nvmf/common.sh@7 -- # uname -s 00:31:55.746 15:32:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:55.746 15:32:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:55.746 15:32:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:55.746 15:32:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:55.746 15:32:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:55.746 15:32:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:55.746 15:32:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:55.746 15:32:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:55.746 15:32:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:55.746 15:32:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:55.746 15:32:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:31:55.746 15:32:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:31:55.746 15:32:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:55.746 15:32:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:55.746 15:32:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:55.746 15:32:59 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:55.746 15:32:59 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:31:55.746 15:32:59 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:55.746 15:32:59 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:55.746 15:32:59 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:55.746 15:32:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:55.746 15:32:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:55.746 15:32:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:55.746 15:32:59 -- paths/export.sh@5 -- # export PATH 00:31:55.747 15:32:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:55.747 15:32:59 -- nvmf/common.sh@47 -- # : 0 00:31:55.747 15:32:59 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:55.747 15:32:59 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:55.747 15:32:59 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:55.747 15:32:59 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:55.747 15:32:59 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:55.747 15:32:59 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:55.747 15:32:59 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:55.747 15:32:59 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:55.747 15:32:59 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:31:55.747 15:32:59 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:31:55.747 15:32:59 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:31:55.747 15:32:59 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:31:55.747 15:32:59 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:31:55.747 15:32:59 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:31:55.747 15:32:59 -- host/auth.sh@21 -- # keys=() 00:31:55.747 15:32:59 -- host/auth.sh@77 -- # nvmftestinit 00:31:55.747 15:32:59 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:55.747 15:32:59 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:55.747 15:32:59 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:55.747 15:32:59 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:55.747 15:32:59 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:55.747 15:32:59 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:55.747 15:32:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:55.747 15:32:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:55.747 15:32:59 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:55.747 15:32:59 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:55.747 15:32:59 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:55.747 15:32:59 -- common/autotest_common.sh@10 -- # set +x 00:32:03.867 15:33:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:03.867 15:33:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:32:03.867 15:33:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:32:03.867 15:33:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:32:03.867 15:33:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:32:03.867 15:33:06 -- nvmf/common.sh@295 -- # net_devs=() 00:32:03.867 15:33:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@296 -- # e810=() 00:32:03.867 15:33:06 -- nvmf/common.sh@296 -- # local -ga e810 00:32:03.867 15:33:06 -- nvmf/common.sh@297 -- # x722=() 00:32:03.867 15:33:06 -- nvmf/common.sh@297 -- # local -ga x722 00:32:03.867 15:33:06 -- nvmf/common.sh@298 -- # mlx=() 00:32:03.867 15:33:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:32:03.867 15:33:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:03.867 15:33:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:32:03.867 Found 0000:18:00.0 (0x8086 - 0x1592) 00:32:03.867 15:33:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:03.867 15:33:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:32:03.867 Found 0000:18:00.1 (0x8086 - 0x1592) 00:32:03.867 15:33:06 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:03.867 15:33:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@377 -- # modinfo irdma 00:32:03.867 15:33:06 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:32:03.867 15:33:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:03.867 15:33:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:03.867 15:33:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:32:03.867 Found net devices under 0000:18:00.0: cvl_0_0 00:32:03.867 15:33:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:03.867 15:33:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:03.867 15:33:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:32:03.867 Found net devices under 0000:18:00.1: cvl_0_1 00:32:03.867 15:33:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:03.867 15:33:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:32:03.867 15:33:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:32:03.867 15:33:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:32:03.867 15:33:06 -- nvmf/common.sh@58 -- # uname 00:32:03.867 15:33:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:32:03.867 15:33:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:32:03.867 15:33:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:32:03.867 15:33:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:32:03.867 15:33:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:32:03.867 15:33:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:32:03.867 15:33:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:32:03.867 15:33:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:32:03.867 15:33:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:32:03.867 15:33:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:32:03.867 15:33:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:32:03.867 15:33:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:03.867 15:33:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:03.867 15:33:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:03.867 15:33:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:32:03.867 15:33:06 -- nvmf/common.sh@105 -- # continue 2 00:32:03.867 15:33:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.867 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:32:03.867 15:33:06 -- nvmf/common.sh@105 -- # continue 2 00:32:03.867 15:33:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:03.867 15:33:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:32:03.867 15:33:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:03.867 15:33:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:32:03.867 15:33:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:32:03.867 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:32:03.867 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:32:03.867 altname enp24s0f0np0 00:32:03.867 altname ens785f0np0 00:32:03.867 inet 192.168.100.8/24 scope global cvl_0_0 00:32:03.867 valid_lft forever preferred_lft forever 00:32:03.867 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:32:03.867 valid_lft forever preferred_lft forever 00:32:03.867 15:33:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:03.867 15:33:06 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:32:03.867 15:33:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:03.867 15:33:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:03.867 15:33:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:32:03.867 15:33:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:32:03.867 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:32:03.867 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:32:03.867 altname enp24s0f1np1 00:32:03.867 altname ens785f1np1 00:32:03.867 inet 192.168.100.9/24 scope global cvl_0_1 00:32:03.867 valid_lft forever preferred_lft forever 00:32:03.867 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:32:03.867 valid_lft forever preferred_lft forever 00:32:03.867 15:33:06 -- nvmf/common.sh@411 -- # return 0 00:32:03.867 15:33:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:32:03.867 15:33:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:32:03.867 15:33:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:32:03.867 15:33:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:32:03.867 15:33:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:32:03.867 15:33:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:03.867 15:33:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:03.868 15:33:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:03.868 15:33:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:03.868 15:33:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:03.868 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.868 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:32:03.868 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.868 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:32:03.868 15:33:06 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:32:03.868 15:33:06 -- nvmf/common.sh@105 -- # continue 2 00:32:03.868 15:33:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:03.868 15:33:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:03.868 15:33:06 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:32:03.868 15:33:06 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:32:03.868 15:33:06 -- nvmf/common.sh@105 -- # continue 2 00:32:03.868 15:33:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:03.868 15:33:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:32:03.868 15:33:06 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:03.868 15:33:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:03.868 15:33:06 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:32:03.868 15:33:06 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:03.868 15:33:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:03.868 15:33:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:32:03.868 192.168.100.9' 00:32:03.868 15:33:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:32:03.868 192.168.100.9' 00:32:03.868 15:33:06 -- nvmf/common.sh@446 -- # head -n 1 00:32:03.868 15:33:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:32:03.868 15:33:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:32:03.868 192.168.100.9' 00:32:03.868 15:33:06 -- nvmf/common.sh@447 -- # tail -n +2 00:32:03.868 15:33:06 -- nvmf/common.sh@447 -- # head -n 1 00:32:03.868 15:33:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:32:03.868 15:33:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:32:03.868 15:33:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:32:03.868 15:33:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:32:03.868 15:33:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:32:03.868 15:33:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:32:03.868 15:33:06 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:32:03.868 15:33:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:32:03.868 15:33:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:32:03.868 15:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:03.868 15:33:06 -- nvmf/common.sh@470 -- # nvmfpid=803586 00:32:03.868 15:33:06 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:32:03.868 15:33:06 -- nvmf/common.sh@471 -- # waitforlisten 803586 00:32:03.868 15:33:06 -- common/autotest_common.sh@817 -- # '[' -z 803586 ']' 00:32:03.868 15:33:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:03.868 15:33:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:03.868 15:33:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:03.868 15:33:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:03.868 15:33:06 -- common/autotest_common.sh@10 -- # set +x 00:32:04.128 15:33:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:04.128 15:33:07 -- common/autotest_common.sh@850 -- # return 0 00:32:04.128 15:33:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:32:04.128 15:33:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:32:04.128 15:33:07 -- common/autotest_common.sh@10 -- # set +x 00:32:04.128 15:33:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:04.128 15:33:07 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:32:04.128 15:33:07 -- host/auth.sh@81 -- # gen_key null 32 00:32:04.128 15:33:07 -- host/auth.sh@53 -- # local digest len file key 00:32:04.128 15:33:07 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.128 15:33:07 -- host/auth.sh@54 -- # local -A digests 00:32:04.128 15:33:07 -- host/auth.sh@56 -- # digest=null 00:32:04.128 15:33:07 -- host/auth.sh@56 -- # len=32 00:32:04.128 15:33:07 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:32:04.128 15:33:07 -- host/auth.sh@57 -- # key=d6162cdc45f74556277cbc6d6ecb74b6 00:32:04.128 15:33:07 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:32:04.128 15:33:07 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.rVN 00:32:04.128 15:33:07 -- host/auth.sh@59 -- # format_dhchap_key d6162cdc45f74556277cbc6d6ecb74b6 0 00:32:04.128 15:33:07 -- nvmf/common.sh@708 -- # format_key DHHC-1 d6162cdc45f74556277cbc6d6ecb74b6 0 00:32:04.128 15:33:07 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # key=d6162cdc45f74556277cbc6d6ecb74b6 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # digest=0 00:32:04.128 15:33:07 -- nvmf/common.sh@694 -- # python - 00:32:04.128 15:33:07 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.rVN 00:32:04.128 15:33:07 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.rVN 00:32:04.128 15:33:07 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.rVN 00:32:04.128 15:33:07 -- host/auth.sh@82 -- # gen_key null 48 00:32:04.128 15:33:07 -- host/auth.sh@53 -- # local digest len file key 00:32:04.128 15:33:07 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.128 15:33:07 -- host/auth.sh@54 -- # local -A digests 00:32:04.128 15:33:07 -- host/auth.sh@56 -- # digest=null 00:32:04.128 15:33:07 -- host/auth.sh@56 -- # len=48 00:32:04.128 15:33:07 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:32:04.128 15:33:07 -- host/auth.sh@57 -- # key=9d6a9830cb9cd21618d8a48b624942d423e236be424e770f 00:32:04.128 15:33:07 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:32:04.128 15:33:07 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.8Hy 00:32:04.128 15:33:07 -- host/auth.sh@59 -- # format_dhchap_key 9d6a9830cb9cd21618d8a48b624942d423e236be424e770f 0 00:32:04.128 15:33:07 -- nvmf/common.sh@708 -- # format_key DHHC-1 9d6a9830cb9cd21618d8a48b624942d423e236be424e770f 0 00:32:04.128 15:33:07 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # key=9d6a9830cb9cd21618d8a48b624942d423e236be424e770f 00:32:04.128 15:33:07 -- nvmf/common.sh@693 -- # digest=0 00:32:04.128 15:33:07 -- nvmf/common.sh@694 -- # python - 00:32:04.128 15:33:07 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.8Hy 00:32:04.128 15:33:08 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.8Hy 00:32:04.128 15:33:08 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.8Hy 00:32:04.128 15:33:08 -- host/auth.sh@83 -- # gen_key sha256 32 00:32:04.128 15:33:08 -- host/auth.sh@53 -- # local digest len file key 00:32:04.128 15:33:08 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.128 15:33:08 -- host/auth.sh@54 -- # local -A digests 00:32:04.128 15:33:08 -- host/auth.sh@56 -- # digest=sha256 00:32:04.128 15:33:08 -- host/auth.sh@56 -- # len=32 00:32:04.128 15:33:08 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:32:04.128 15:33:08 -- host/auth.sh@57 -- # key=ab003bee658f16195570a652abd36958 00:32:04.128 15:33:08 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:32:04.128 15:33:08 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.k0d 00:32:04.128 15:33:08 -- host/auth.sh@59 -- # format_dhchap_key ab003bee658f16195570a652abd36958 1 00:32:04.128 15:33:08 -- nvmf/common.sh@708 -- # format_key DHHC-1 ab003bee658f16195570a652abd36958 1 00:32:04.128 15:33:08 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.128 15:33:08 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.128 15:33:08 -- nvmf/common.sh@693 -- # key=ab003bee658f16195570a652abd36958 00:32:04.128 15:33:08 -- nvmf/common.sh@693 -- # digest=1 00:32:04.128 15:33:08 -- nvmf/common.sh@694 -- # python - 00:32:04.387 15:33:08 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.k0d 00:32:04.387 15:33:08 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.k0d 00:32:04.387 15:33:08 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.k0d 00:32:04.387 15:33:08 -- host/auth.sh@84 -- # gen_key sha384 48 00:32:04.387 15:33:08 -- host/auth.sh@53 -- # local digest len file key 00:32:04.387 15:33:08 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.387 15:33:08 -- host/auth.sh@54 -- # local -A digests 00:32:04.387 15:33:08 -- host/auth.sh@56 -- # digest=sha384 00:32:04.387 15:33:08 -- host/auth.sh@56 -- # len=48 00:32:04.387 15:33:08 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:32:04.387 15:33:08 -- host/auth.sh@57 -- # key=1e6e60887ee272413a8b431bf0eae691729bdbf51a945b8e 00:32:04.387 15:33:08 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:32:04.387 15:33:08 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.tuE 00:32:04.387 15:33:08 -- host/auth.sh@59 -- # format_dhchap_key 1e6e60887ee272413a8b431bf0eae691729bdbf51a945b8e 2 00:32:04.387 15:33:08 -- nvmf/common.sh@708 -- # format_key DHHC-1 1e6e60887ee272413a8b431bf0eae691729bdbf51a945b8e 2 00:32:04.387 15:33:08 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # key=1e6e60887ee272413a8b431bf0eae691729bdbf51a945b8e 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # digest=2 00:32:04.387 15:33:08 -- nvmf/common.sh@694 -- # python - 00:32:04.387 15:33:08 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.tuE 00:32:04.387 15:33:08 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.tuE 00:32:04.387 15:33:08 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.tuE 00:32:04.387 15:33:08 -- host/auth.sh@85 -- # gen_key sha512 64 00:32:04.387 15:33:08 -- host/auth.sh@53 -- # local digest len file key 00:32:04.387 15:33:08 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.387 15:33:08 -- host/auth.sh@54 -- # local -A digests 00:32:04.387 15:33:08 -- host/auth.sh@56 -- # digest=sha512 00:32:04.387 15:33:08 -- host/auth.sh@56 -- # len=64 00:32:04.387 15:33:08 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:32:04.387 15:33:08 -- host/auth.sh@57 -- # key=38e56ba8fde11d0481d299d39a47eb58c34bbbeb2f4a6f70b706733c96af3231 00:32:04.387 15:33:08 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:32:04.387 15:33:08 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.sMU 00:32:04.387 15:33:08 -- host/auth.sh@59 -- # format_dhchap_key 38e56ba8fde11d0481d299d39a47eb58c34bbbeb2f4a6f70b706733c96af3231 3 00:32:04.387 15:33:08 -- nvmf/common.sh@708 -- # format_key DHHC-1 38e56ba8fde11d0481d299d39a47eb58c34bbbeb2f4a6f70b706733c96af3231 3 00:32:04.387 15:33:08 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # key=38e56ba8fde11d0481d299d39a47eb58c34bbbeb2f4a6f70b706733c96af3231 00:32:04.387 15:33:08 -- nvmf/common.sh@693 -- # digest=3 00:32:04.387 15:33:08 -- nvmf/common.sh@694 -- # python - 00:32:04.387 15:33:08 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.sMU 00:32:04.387 15:33:08 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.sMU 00:32:04.387 15:33:08 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.sMU 00:32:04.387 15:33:08 -- host/auth.sh@87 -- # waitforlisten 803586 00:32:04.387 15:33:08 -- common/autotest_common.sh@817 -- # '[' -z 803586 ']' 00:32:04.387 15:33:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:04.387 15:33:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:04.387 15:33:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:04.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:04.387 15:33:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:04.387 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.647 15:33:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:04.647 15:33:08 -- common/autotest_common.sh@850 -- # return 0 00:32:04.647 15:33:08 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:04.647 15:33:08 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.rVN 00:32:04.647 15:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.647 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.647 15:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.647 15:33:08 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:04.648 15:33:08 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.8Hy 00:32:04.648 15:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.648 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.648 15:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.648 15:33:08 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:04.648 15:33:08 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.k0d 00:32:04.648 15:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.648 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.648 15:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.648 15:33:08 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:04.648 15:33:08 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.tuE 00:32:04.648 15:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.648 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.648 15:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.648 15:33:08 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:04.648 15:33:08 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.sMU 00:32:04.648 15:33:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:04.648 15:33:08 -- common/autotest_common.sh@10 -- # set +x 00:32:04.648 15:33:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:04.648 15:33:08 -- host/auth.sh@92 -- # nvmet_auth_init 00:32:04.648 15:33:08 -- host/auth.sh@35 -- # get_main_ns_ip 00:32:04.648 15:33:08 -- nvmf/common.sh@717 -- # local ip 00:32:04.648 15:33:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:04.648 15:33:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:04.648 15:33:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:04.648 15:33:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:04.648 15:33:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:04.648 15:33:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:04.648 15:33:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:04.648 15:33:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:04.648 15:33:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:04.648 15:33:08 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:32:04.648 15:33:08 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:32:04.648 15:33:08 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:32:04.648 15:33:08 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:04.648 15:33:08 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:04.648 15:33:08 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:04.648 15:33:08 -- nvmf/common.sh@628 -- # local block nvme 00:32:04.648 15:33:08 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:32:04.648 15:33:08 -- nvmf/common.sh@631 -- # modprobe nvmet 00:32:04.648 15:33:08 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:04.648 15:33:08 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset 00:32:08.852 Waiting for block devices as requested 00:32:08.852 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:32:08.852 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:08.852 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:09.111 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:09.111 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:09.111 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:09.371 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:09.371 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:09.371 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:09.630 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:10.199 15:33:14 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:32:10.199 15:33:14 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:10.199 15:33:14 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:32:10.199 15:33:14 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:32:10.199 15:33:14 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:32:10.199 15:33:14 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:32:10.199 15:33:14 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:32:10.199 15:33:14 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:32:10.199 15:33:14 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:10.199 No valid GPT data, bailing 00:32:10.199 15:33:14 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:10.199 15:33:14 -- scripts/common.sh@391 -- # pt= 00:32:10.199 15:33:14 -- scripts/common.sh@392 -- # return 1 00:32:10.199 15:33:14 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:32:10.199 15:33:14 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:32:10.199 15:33:14 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:10.458 15:33:14 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:10.458 15:33:14 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:10.458 15:33:14 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:32:10.458 15:33:14 -- nvmf/common.sh@656 -- # echo 1 00:32:10.458 15:33:14 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:32:10.458 15:33:14 -- nvmf/common.sh@658 -- # echo 1 00:32:10.458 15:33:14 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:32:10.458 15:33:14 -- nvmf/common.sh@661 -- # echo rdma 00:32:10.458 15:33:14 -- nvmf/common.sh@662 -- # echo 4420 00:32:10.458 15:33:14 -- nvmf/common.sh@663 -- # echo ipv4 00:32:10.458 15:33:14 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:10.458 15:33:14 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 --hostid=80e71deb-ee4e-e711-906e-0012795d9712 -a 192.168.100.8 -t rdma -s 4420 00:32:10.458 00:32:10.458 Discovery Log Number of Records 2, Generation counter 2 00:32:10.458 =====Discovery Log Entry 0====== 00:32:10.458 trtype: rdma 00:32:10.458 adrfam: ipv4 00:32:10.458 subtype: current discovery subsystem 00:32:10.458 treq: not specified, sq flow control disable supported 00:32:10.458 portid: 1 00:32:10.458 trsvcid: 4420 00:32:10.458 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:10.458 traddr: 192.168.100.8 00:32:10.458 eflags: none 00:32:10.458 rdma_prtype: not specified 00:32:10.458 rdma_qptype: connected 00:32:10.458 rdma_cms: rdma-cm 00:32:10.458 rdma_pkey: 0x0000 00:32:10.458 =====Discovery Log Entry 1====== 00:32:10.458 trtype: rdma 00:32:10.458 adrfam: ipv4 00:32:10.458 subtype: nvme subsystem 00:32:10.458 treq: not specified, sq flow control disable supported 00:32:10.458 portid: 1 00:32:10.458 trsvcid: 4420 00:32:10.458 subnqn: nqn.2024-02.io.spdk:cnode0 00:32:10.458 traddr: 192.168.100.8 00:32:10.458 eflags: none 00:32:10.458 rdma_prtype: not specified 00:32:10.458 rdma_qptype: connected 00:32:10.458 rdma_cms: rdma-cm 00:32:10.458 rdma_pkey: 0x0000 00:32:10.458 15:33:14 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:32:10.458 15:33:14 -- host/auth.sh@37 -- # echo 0 00:32:10.458 15:33:14 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:32:10.458 15:33:14 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:10.458 15:33:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.458 15:33:14 -- host/auth.sh@44 -- # digest=sha256 00:32:10.458 15:33:14 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.458 15:33:14 -- host/auth.sh@44 -- # keyid=1 00:32:10.458 15:33:14 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:10.458 15:33:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:10.458 15:33:14 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.718 15:33:14 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:10.718 15:33:14 -- host/auth.sh@100 -- # IFS=, 00:32:10.718 15:33:14 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:32:10.718 15:33:14 -- host/auth.sh@100 -- # IFS=, 00:32:10.718 15:33:14 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:10.718 15:33:14 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:32:10.718 15:33:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.718 15:33:14 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:32:10.718 15:33:14 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:10.718 15:33:14 -- host/auth.sh@68 -- # keyid=1 00:32:10.718 15:33:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:10.718 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.718 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.718 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.718 15:33:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.718 15:33:14 -- nvmf/common.sh@717 -- # local ip 00:32:10.718 15:33:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.718 15:33:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.718 15:33:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.718 15:33:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.718 15:33:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.718 15:33:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.718 15:33:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.718 15:33:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.718 15:33:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.718 15:33:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:10.718 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.718 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.718 nvme0n1 00:32:10.718 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.718 15:33:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.718 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.718 15:33:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.718 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.718 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.718 15:33:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.718 15:33:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.718 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.718 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:10.978 15:33:14 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:10.978 15:33:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.978 15:33:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:32:10.978 15:33:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # digest=sha256 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # keyid=0 00:32:10.978 15:33:14 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:10.978 15:33:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:10.978 15:33:14 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:10.978 15:33:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:32:10.978 15:33:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # digest=sha256 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # keyid=0 00:32:10.978 15:33:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:10.978 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.978 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:10.978 15:33:14 -- nvmf/common.sh@717 -- # local ip 00:32:10.978 15:33:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:10.978 15:33:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:10.978 15:33:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:10.978 15:33:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:10.978 15:33:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:10.978 15:33:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:10.978 15:33:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:10.978 15:33:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:10.978 15:33:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:10.978 15:33:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:10.978 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.978 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 nvme0n1 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:10.978 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.978 15:33:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:10.978 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:10.978 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.978 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:10.978 15:33:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:10.978 15:33:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:10.978 15:33:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # digest=sha256 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@44 -- # keyid=1 00:32:10.978 15:33:14 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:10.978 15:33:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:10.978 15:33:14 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:10.978 15:33:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:32:10.978 15:33:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # digest=sha256 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:10.978 15:33:14 -- host/auth.sh@68 -- # keyid=1 00:32:10.978 15:33:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:10.978 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:10.978 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:10.978 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.238 15:33:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.238 15:33:14 -- nvmf/common.sh@717 -- # local ip 00:32:11.238 15:33:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.238 15:33:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.238 15:33:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.238 15:33:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.238 15:33:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.238 15:33:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.238 15:33:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.238 15:33:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.238 15:33:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.238 15:33:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:11.238 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.238 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:32:11.238 nvme0n1 00:32:11.238 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.238 15:33:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.238 15:33:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.238 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.238 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.238 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.238 15:33:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.238 15:33:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.238 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.238 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.238 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.238 15:33:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.238 15:33:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:32:11.238 15:33:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.238 15:33:15 -- host/auth.sh@44 -- # digest=sha256 00:32:11.238 15:33:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.238 15:33:15 -- host/auth.sh@44 -- # keyid=2 00:32:11.238 15:33:15 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:11.238 15:33:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.238 15:33:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.238 15:33:15 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:11.238 15:33:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:32:11.238 15:33:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.238 15:33:15 -- host/auth.sh@68 -- # digest=sha256 00:32:11.238 15:33:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.238 15:33:15 -- host/auth.sh@68 -- # keyid=2 00:32:11.238 15:33:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.238 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.238 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.238 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.238 15:33:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.238 15:33:15 -- nvmf/common.sh@717 -- # local ip 00:32:11.238 15:33:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.238 15:33:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.238 15:33:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.238 15:33:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.238 15:33:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.238 15:33:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.238 15:33:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.239 15:33:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.239 15:33:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.239 15:33:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:11.239 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.239 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.498 nvme0n1 00:32:11.498 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.498 15:33:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.498 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.498 15:33:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.498 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.498 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.498 15:33:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.498 15:33:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.498 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.498 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.499 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.499 15:33:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.499 15:33:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:32:11.499 15:33:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.499 15:33:15 -- host/auth.sh@44 -- # digest=sha256 00:32:11.499 15:33:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.499 15:33:15 -- host/auth.sh@44 -- # keyid=3 00:32:11.499 15:33:15 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:11.499 15:33:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.499 15:33:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.499 15:33:15 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:11.499 15:33:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:32:11.499 15:33:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.499 15:33:15 -- host/auth.sh@68 -- # digest=sha256 00:32:11.499 15:33:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.499 15:33:15 -- host/auth.sh@68 -- # keyid=3 00:32:11.499 15:33:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.499 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.499 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.499 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.499 15:33:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.499 15:33:15 -- nvmf/common.sh@717 -- # local ip 00:32:11.499 15:33:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.499 15:33:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.499 15:33:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.499 15:33:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.499 15:33:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.499 15:33:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.499 15:33:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.499 15:33:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.499 15:33:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.499 15:33:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:11.499 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.499 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.759 nvme0n1 00:32:11.759 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.759 15:33:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.759 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.759 15:33:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.759 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.759 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.759 15:33:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.759 15:33:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.759 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.759 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.759 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.759 15:33:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.759 15:33:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:32:11.759 15:33:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.759 15:33:15 -- host/auth.sh@44 -- # digest=sha256 00:32:11.759 15:33:15 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.759 15:33:15 -- host/auth.sh@44 -- # keyid=4 00:32:11.759 15:33:15 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:11.759 15:33:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.759 15:33:15 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.759 15:33:15 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:11.759 15:33:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:32:11.759 15:33:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.759 15:33:15 -- host/auth.sh@68 -- # digest=sha256 00:32:11.759 15:33:15 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.759 15:33:15 -- host/auth.sh@68 -- # keyid=4 00:32:11.759 15:33:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.759 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.759 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:11.759 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.759 15:33:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.759 15:33:15 -- nvmf/common.sh@717 -- # local ip 00:32:11.759 15:33:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.759 15:33:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.759 15:33:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.759 15:33:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.759 15:33:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.759 15:33:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.759 15:33:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.759 15:33:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.759 15:33:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.759 15:33:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:11.759 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.759 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:12.019 nvme0n1 00:32:12.019 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.019 15:33:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.019 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.019 15:33:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.019 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:12.019 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.019 15:33:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.019 15:33:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.019 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.019 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:32:12.019 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.019 15:33:15 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:12.019 15:33:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.019 15:33:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:32:12.019 15:33:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.019 15:33:15 -- host/auth.sh@44 -- # digest=sha256 00:32:12.019 15:33:15 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.019 15:33:15 -- host/auth.sh@44 -- # keyid=0 00:32:12.019 15:33:15 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:12.019 15:33:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.019 15:33:15 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.278 15:33:16 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:12.278 15:33:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:32:12.278 15:33:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.278 15:33:16 -- host/auth.sh@68 -- # digest=sha256 00:32:12.278 15:33:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.278 15:33:16 -- host/auth.sh@68 -- # keyid=0 00:32:12.278 15:33:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:12.278 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.278 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.278 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.278 15:33:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.278 15:33:16 -- nvmf/common.sh@717 -- # local ip 00:32:12.278 15:33:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.278 15:33:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.278 15:33:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.278 15:33:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.278 15:33:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.278 15:33:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.278 15:33:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.278 15:33:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.278 15:33:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.278 15:33:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:12.278 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.278 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.538 nvme0n1 00:32:12.538 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.538 15:33:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.538 15:33:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.538 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.538 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.538 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.538 15:33:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.538 15:33:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.538 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.538 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.538 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.538 15:33:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.538 15:33:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:32:12.538 15:33:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.538 15:33:16 -- host/auth.sh@44 -- # digest=sha256 00:32:12.538 15:33:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.538 15:33:16 -- host/auth.sh@44 -- # keyid=1 00:32:12.538 15:33:16 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:12.538 15:33:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.538 15:33:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.538 15:33:16 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:12.538 15:33:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:32:12.538 15:33:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.538 15:33:16 -- host/auth.sh@68 -- # digest=sha256 00:32:12.538 15:33:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.538 15:33:16 -- host/auth.sh@68 -- # keyid=1 00:32:12.538 15:33:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:12.538 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.538 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.538 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.538 15:33:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.538 15:33:16 -- nvmf/common.sh@717 -- # local ip 00:32:12.538 15:33:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.538 15:33:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.538 15:33:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.538 15:33:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.538 15:33:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.538 15:33:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.538 15:33:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.538 15:33:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.538 15:33:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.538 15:33:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:12.538 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.538 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.797 nvme0n1 00:32:12.797 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.797 15:33:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.798 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.798 15:33:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.798 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.798 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.798 15:33:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.798 15:33:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.798 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.798 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.798 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.798 15:33:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.798 15:33:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:32:12.798 15:33:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.798 15:33:16 -- host/auth.sh@44 -- # digest=sha256 00:32:12.798 15:33:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.798 15:33:16 -- host/auth.sh@44 -- # keyid=2 00:32:12.798 15:33:16 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:12.798 15:33:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.798 15:33:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.798 15:33:16 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:12.798 15:33:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:32:12.798 15:33:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.798 15:33:16 -- host/auth.sh@68 -- # digest=sha256 00:32:12.798 15:33:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.798 15:33:16 -- host/auth.sh@68 -- # keyid=2 00:32:12.798 15:33:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:12.798 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.798 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:12.798 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.798 15:33:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.798 15:33:16 -- nvmf/common.sh@717 -- # local ip 00:32:12.798 15:33:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.798 15:33:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.798 15:33:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.798 15:33:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.798 15:33:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.798 15:33:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.798 15:33:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.798 15:33:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.798 15:33:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.798 15:33:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:12.798 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.798 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.057 nvme0n1 00:32:13.058 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.058 15:33:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.058 15:33:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.058 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.058 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.058 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.058 15:33:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.058 15:33:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.058 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.058 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.058 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.058 15:33:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.058 15:33:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:32:13.058 15:33:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.058 15:33:16 -- host/auth.sh@44 -- # digest=sha256 00:32:13.058 15:33:16 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.058 15:33:16 -- host/auth.sh@44 -- # keyid=3 00:32:13.058 15:33:16 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:13.058 15:33:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.058 15:33:16 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.058 15:33:16 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:13.058 15:33:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:32:13.058 15:33:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.058 15:33:16 -- host/auth.sh@68 -- # digest=sha256 00:32:13.058 15:33:16 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.058 15:33:16 -- host/auth.sh@68 -- # keyid=3 00:32:13.058 15:33:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.058 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.058 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.058 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.058 15:33:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.058 15:33:16 -- nvmf/common.sh@717 -- # local ip 00:32:13.058 15:33:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.058 15:33:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.058 15:33:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.058 15:33:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.058 15:33:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.058 15:33:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.058 15:33:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.058 15:33:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.058 15:33:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.058 15:33:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:13.058 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.058 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.318 nvme0n1 00:32:13.318 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.318 15:33:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.318 15:33:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.318 15:33:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.318 15:33:16 -- common/autotest_common.sh@10 -- # set +x 00:32:13.318 15:33:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.318 15:33:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.318 15:33:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.318 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.318 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.318 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.318 15:33:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.318 15:33:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:32:13.318 15:33:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.318 15:33:17 -- host/auth.sh@44 -- # digest=sha256 00:32:13.318 15:33:17 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.318 15:33:17 -- host/auth.sh@44 -- # keyid=4 00:32:13.318 15:33:17 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:13.318 15:33:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.318 15:33:17 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.318 15:33:17 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:13.318 15:33:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:32:13.318 15:33:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.318 15:33:17 -- host/auth.sh@68 -- # digest=sha256 00:32:13.318 15:33:17 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.318 15:33:17 -- host/auth.sh@68 -- # keyid=4 00:32:13.318 15:33:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.318 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.318 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.318 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.318 15:33:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.318 15:33:17 -- nvmf/common.sh@717 -- # local ip 00:32:13.318 15:33:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.318 15:33:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.318 15:33:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.318 15:33:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.318 15:33:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.318 15:33:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.318 15:33:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.318 15:33:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.318 15:33:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.318 15:33:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:13.318 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.318 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.577 nvme0n1 00:32:13.577 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.577 15:33:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.577 15:33:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.577 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.577 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.577 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.577 15:33:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.577 15:33:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.577 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.577 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.577 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.577 15:33:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:13.577 15:33:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.577 15:33:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:32:13.577 15:33:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.577 15:33:17 -- host/auth.sh@44 -- # digest=sha256 00:32:13.577 15:33:17 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:13.577 15:33:17 -- host/auth.sh@44 -- # keyid=0 00:32:13.577 15:33:17 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:13.577 15:33:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.578 15:33:17 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:13.837 15:33:17 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:13.837 15:33:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:32:13.837 15:33:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.837 15:33:17 -- host/auth.sh@68 -- # digest=sha256 00:32:13.837 15:33:17 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:13.837 15:33:17 -- host/auth.sh@68 -- # keyid=0 00:32:13.837 15:33:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:13.837 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.837 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:13.837 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.096 15:33:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.096 15:33:17 -- nvmf/common.sh@717 -- # local ip 00:32:14.097 15:33:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.097 15:33:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.097 15:33:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.097 15:33:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.097 15:33:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.097 15:33:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.097 15:33:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.097 15:33:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.097 15:33:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.097 15:33:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:14.097 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.097 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:14.097 nvme0n1 00:32:14.097 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.097 15:33:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.097 15:33:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.097 15:33:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.097 15:33:17 -- common/autotest_common.sh@10 -- # set +x 00:32:14.097 15:33:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.356 15:33:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.356 15:33:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.356 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.356 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.356 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.356 15:33:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.356 15:33:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:32:14.356 15:33:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.356 15:33:18 -- host/auth.sh@44 -- # digest=sha256 00:32:14.356 15:33:18 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:14.356 15:33:18 -- host/auth.sh@44 -- # keyid=1 00:32:14.356 15:33:18 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:14.356 15:33:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:14.356 15:33:18 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:14.356 15:33:18 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:14.356 15:33:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:32:14.356 15:33:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.356 15:33:18 -- host/auth.sh@68 -- # digest=sha256 00:32:14.356 15:33:18 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:14.356 15:33:18 -- host/auth.sh@68 -- # keyid=1 00:32:14.356 15:33:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:14.356 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.356 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.356 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.356 15:33:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.356 15:33:18 -- nvmf/common.sh@717 -- # local ip 00:32:14.356 15:33:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.356 15:33:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.356 15:33:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.356 15:33:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.356 15:33:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.356 15:33:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.356 15:33:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.356 15:33:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.356 15:33:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.356 15:33:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:14.356 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.356 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.616 nvme0n1 00:32:14.616 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.616 15:33:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.616 15:33:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.616 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.616 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.616 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.616 15:33:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.616 15:33:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.616 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.616 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.616 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.616 15:33:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.616 15:33:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:32:14.616 15:33:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.616 15:33:18 -- host/auth.sh@44 -- # digest=sha256 00:32:14.616 15:33:18 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:14.616 15:33:18 -- host/auth.sh@44 -- # keyid=2 00:32:14.616 15:33:18 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:14.616 15:33:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:14.616 15:33:18 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:14.616 15:33:18 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:14.616 15:33:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:32:14.616 15:33:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.616 15:33:18 -- host/auth.sh@68 -- # digest=sha256 00:32:14.616 15:33:18 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:14.616 15:33:18 -- host/auth.sh@68 -- # keyid=2 00:32:14.616 15:33:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:14.616 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.616 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.616 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.616 15:33:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.616 15:33:18 -- nvmf/common.sh@717 -- # local ip 00:32:14.616 15:33:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.616 15:33:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.616 15:33:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.616 15:33:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.616 15:33:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.616 15:33:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.616 15:33:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.616 15:33:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.617 15:33:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.617 15:33:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:14.617 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.617 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.876 nvme0n1 00:32:14.876 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.876 15:33:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.876 15:33:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.876 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.876 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.876 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.876 15:33:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.876 15:33:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.876 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.876 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.876 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.876 15:33:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.876 15:33:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:32:14.876 15:33:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.876 15:33:18 -- host/auth.sh@44 -- # digest=sha256 00:32:14.876 15:33:18 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:14.876 15:33:18 -- host/auth.sh@44 -- # keyid=3 00:32:14.876 15:33:18 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:14.876 15:33:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:14.876 15:33:18 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:14.876 15:33:18 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:14.876 15:33:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:32:14.876 15:33:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.876 15:33:18 -- host/auth.sh@68 -- # digest=sha256 00:32:14.876 15:33:18 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:14.876 15:33:18 -- host/auth.sh@68 -- # keyid=3 00:32:14.876 15:33:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:14.876 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.876 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:14.876 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.876 15:33:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.876 15:33:18 -- nvmf/common.sh@717 -- # local ip 00:32:14.876 15:33:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.876 15:33:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.876 15:33:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.876 15:33:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.876 15:33:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.876 15:33:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.876 15:33:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.876 15:33:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.876 15:33:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.876 15:33:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:14.876 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.876 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:15.137 nvme0n1 00:32:15.137 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.137 15:33:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.137 15:33:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.137 15:33:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.137 15:33:18 -- common/autotest_common.sh@10 -- # set +x 00:32:15.137 15:33:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.137 15:33:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.137 15:33:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.137 15:33:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.137 15:33:19 -- common/autotest_common.sh@10 -- # set +x 00:32:15.137 15:33:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.137 15:33:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.137 15:33:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:32:15.137 15:33:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.137 15:33:19 -- host/auth.sh@44 -- # digest=sha256 00:32:15.137 15:33:19 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:15.137 15:33:19 -- host/auth.sh@44 -- # keyid=4 00:32:15.137 15:33:19 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:15.137 15:33:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.137 15:33:19 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:15.137 15:33:19 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:15.137 15:33:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:32:15.137 15:33:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.137 15:33:19 -- host/auth.sh@68 -- # digest=sha256 00:32:15.137 15:33:19 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:15.137 15:33:19 -- host/auth.sh@68 -- # keyid=4 00:32:15.137 15:33:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:15.137 15:33:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.137 15:33:19 -- common/autotest_common.sh@10 -- # set +x 00:32:15.137 15:33:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.397 15:33:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.397 15:33:19 -- nvmf/common.sh@717 -- # local ip 00:32:15.397 15:33:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.397 15:33:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.397 15:33:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.397 15:33:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.397 15:33:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.397 15:33:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.397 15:33:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.397 15:33:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.397 15:33:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.397 15:33:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:15.397 15:33:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.397 15:33:19 -- common/autotest_common.sh@10 -- # set +x 00:32:15.397 nvme0n1 00:32:15.397 15:33:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.397 15:33:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.397 15:33:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.397 15:33:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.397 15:33:19 -- common/autotest_common.sh@10 -- # set +x 00:32:15.397 15:33:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.657 15:33:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.657 15:33:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.657 15:33:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.657 15:33:19 -- common/autotest_common.sh@10 -- # set +x 00:32:15.657 15:33:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.657 15:33:19 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:15.657 15:33:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.657 15:33:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:32:15.657 15:33:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.657 15:33:19 -- host/auth.sh@44 -- # digest=sha256 00:32:15.657 15:33:19 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:15.657 15:33:19 -- host/auth.sh@44 -- # keyid=0 00:32:15.657 15:33:19 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:15.657 15:33:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.657 15:33:19 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:17.037 15:33:20 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:17.037 15:33:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:32:17.037 15:33:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.037 15:33:20 -- host/auth.sh@68 -- # digest=sha256 00:32:17.037 15:33:20 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:17.037 15:33:20 -- host/auth.sh@68 -- # keyid=0 00:32:17.037 15:33:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:17.037 15:33:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.037 15:33:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.037 15:33:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.037 15:33:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.037 15:33:20 -- nvmf/common.sh@717 -- # local ip 00:32:17.037 15:33:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.037 15:33:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.037 15:33:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.037 15:33:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.037 15:33:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.037 15:33:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.037 15:33:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.037 15:33:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.037 15:33:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.037 15:33:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:17.037 15:33:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.037 15:33:20 -- common/autotest_common.sh@10 -- # set +x 00:32:17.296 nvme0n1 00:32:17.296 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.296 15:33:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:17.296 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.296 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.296 15:33:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:17.296 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.296 15:33:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:17.296 15:33:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:17.296 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.296 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.296 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.296 15:33:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:17.296 15:33:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:32:17.296 15:33:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:17.296 15:33:21 -- host/auth.sh@44 -- # digest=sha256 00:32:17.296 15:33:21 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:17.296 15:33:21 -- host/auth.sh@44 -- # keyid=1 00:32:17.296 15:33:21 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:17.296 15:33:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:17.296 15:33:21 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:17.296 15:33:21 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:17.296 15:33:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:32:17.296 15:33:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.296 15:33:21 -- host/auth.sh@68 -- # digest=sha256 00:32:17.296 15:33:21 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:17.296 15:33:21 -- host/auth.sh@68 -- # keyid=1 00:32:17.296 15:33:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:17.296 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.296 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.296 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.296 15:33:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.296 15:33:21 -- nvmf/common.sh@717 -- # local ip 00:32:17.296 15:33:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.296 15:33:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.296 15:33:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.296 15:33:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.296 15:33:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.296 15:33:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.296 15:33:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.296 15:33:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.296 15:33:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.296 15:33:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:17.296 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.296 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.865 nvme0n1 00:32:17.865 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.865 15:33:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:17.865 15:33:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:17.865 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.865 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.865 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.865 15:33:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:17.865 15:33:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:17.865 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.865 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.865 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.865 15:33:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:17.865 15:33:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:32:17.865 15:33:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:17.865 15:33:21 -- host/auth.sh@44 -- # digest=sha256 00:32:17.865 15:33:21 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:17.865 15:33:21 -- host/auth.sh@44 -- # keyid=2 00:32:17.865 15:33:21 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:17.865 15:33:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:17.865 15:33:21 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:17.865 15:33:21 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:17.865 15:33:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:32:17.865 15:33:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.865 15:33:21 -- host/auth.sh@68 -- # digest=sha256 00:32:17.865 15:33:21 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:17.865 15:33:21 -- host/auth.sh@68 -- # keyid=2 00:32:17.865 15:33:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:17.865 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.865 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:17.865 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.865 15:33:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.865 15:33:21 -- nvmf/common.sh@717 -- # local ip 00:32:17.865 15:33:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.865 15:33:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.865 15:33:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.865 15:33:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.865 15:33:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.865 15:33:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.865 15:33:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.865 15:33:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.865 15:33:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.865 15:33:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:17.865 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.865 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:18.125 nvme0n1 00:32:18.125 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.125 15:33:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.125 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.125 15:33:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.125 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:18.125 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.125 15:33:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.125 15:33:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.125 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.125 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:18.125 15:33:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.125 15:33:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.125 15:33:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:32:18.125 15:33:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.125 15:33:21 -- host/auth.sh@44 -- # digest=sha256 00:32:18.125 15:33:21 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:18.125 15:33:21 -- host/auth.sh@44 -- # keyid=3 00:32:18.125 15:33:21 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:18.125 15:33:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:18.125 15:33:21 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:18.125 15:33:21 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:18.125 15:33:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:32:18.125 15:33:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.125 15:33:21 -- host/auth.sh@68 -- # digest=sha256 00:32:18.125 15:33:21 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:18.125 15:33:21 -- host/auth.sh@68 -- # keyid=3 00:32:18.125 15:33:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:18.125 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.125 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:32:18.125 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.125 15:33:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.125 15:33:22 -- nvmf/common.sh@717 -- # local ip 00:32:18.125 15:33:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.125 15:33:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.125 15:33:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.125 15:33:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.125 15:33:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.125 15:33:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.125 15:33:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.125 15:33:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.125 15:33:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.125 15:33:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:18.125 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.125 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.694 nvme0n1 00:32:18.694 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.694 15:33:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.694 15:33:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.694 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.694 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.694 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.694 15:33:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.694 15:33:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.694 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.694 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.694 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.694 15:33:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.694 15:33:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:32:18.694 15:33:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.694 15:33:22 -- host/auth.sh@44 -- # digest=sha256 00:32:18.694 15:33:22 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:18.694 15:33:22 -- host/auth.sh@44 -- # keyid=4 00:32:18.694 15:33:22 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:18.694 15:33:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:18.694 15:33:22 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:18.694 15:33:22 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:18.694 15:33:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:32:18.694 15:33:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.694 15:33:22 -- host/auth.sh@68 -- # digest=sha256 00:32:18.694 15:33:22 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:18.694 15:33:22 -- host/auth.sh@68 -- # keyid=4 00:32:18.694 15:33:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:18.694 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.694 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.694 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.694 15:33:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.694 15:33:22 -- nvmf/common.sh@717 -- # local ip 00:32:18.694 15:33:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.694 15:33:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.694 15:33:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.694 15:33:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.694 15:33:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.694 15:33:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.694 15:33:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.694 15:33:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.694 15:33:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.694 15:33:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:18.694 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.694 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.953 nvme0n1 00:32:18.953 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.953 15:33:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.953 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.953 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:18.953 15:33:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.953 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.213 15:33:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:19.213 15:33:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:19.213 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.213 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:32:19.213 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.213 15:33:22 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:19.213 15:33:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:19.213 15:33:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:32:19.213 15:33:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:19.213 15:33:22 -- host/auth.sh@44 -- # digest=sha256 00:32:19.213 15:33:22 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:19.213 15:33:22 -- host/auth.sh@44 -- # keyid=0 00:32:19.213 15:33:22 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:19.213 15:33:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:19.213 15:33:22 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:21.751 15:33:25 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:21.751 15:33:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:32:21.751 15:33:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:21.751 15:33:25 -- host/auth.sh@68 -- # digest=sha256 00:32:21.751 15:33:25 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:21.751 15:33:25 -- host/auth.sh@68 -- # keyid=0 00:32:21.751 15:33:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:22.010 15:33:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.010 15:33:25 -- common/autotest_common.sh@10 -- # set +x 00:32:22.010 15:33:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.010 15:33:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:22.010 15:33:25 -- nvmf/common.sh@717 -- # local ip 00:32:22.010 15:33:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:22.010 15:33:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:22.010 15:33:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:22.010 15:33:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:22.010 15:33:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:22.010 15:33:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:22.010 15:33:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:22.010 15:33:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:22.010 15:33:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:22.010 15:33:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:22.010 15:33:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.010 15:33:25 -- common/autotest_common.sh@10 -- # set +x 00:32:22.579 nvme0n1 00:32:22.579 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.579 15:33:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:22.579 15:33:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:22.579 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.579 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:22.579 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.579 15:33:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:22.579 15:33:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:22.579 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.579 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:22.579 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.579 15:33:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:22.579 15:33:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:32:22.579 15:33:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:22.579 15:33:26 -- host/auth.sh@44 -- # digest=sha256 00:32:22.579 15:33:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:22.579 15:33:26 -- host/auth.sh@44 -- # keyid=1 00:32:22.579 15:33:26 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:22.579 15:33:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:22.579 15:33:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:22.579 15:33:26 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:22.579 15:33:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:32:22.579 15:33:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:22.579 15:33:26 -- host/auth.sh@68 -- # digest=sha256 00:32:22.579 15:33:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:22.579 15:33:26 -- host/auth.sh@68 -- # keyid=1 00:32:22.579 15:33:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:22.579 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.579 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:22.579 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.579 15:33:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:22.579 15:33:26 -- nvmf/common.sh@717 -- # local ip 00:32:22.579 15:33:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:22.579 15:33:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:22.579 15:33:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:22.579 15:33:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:22.579 15:33:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:22.579 15:33:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:22.579 15:33:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:22.579 15:33:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:22.579 15:33:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:22.579 15:33:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:22.579 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.579 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:23.148 nvme0n1 00:32:23.148 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.148 15:33:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:23.148 15:33:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:23.148 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.148 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:23.148 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.148 15:33:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:23.148 15:33:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:23.148 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.148 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:23.148 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.148 15:33:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:23.148 15:33:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:32:23.148 15:33:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:23.148 15:33:26 -- host/auth.sh@44 -- # digest=sha256 00:32:23.148 15:33:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:23.148 15:33:26 -- host/auth.sh@44 -- # keyid=2 00:32:23.148 15:33:26 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:23.148 15:33:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:23.148 15:33:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:23.148 15:33:26 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:23.148 15:33:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:32:23.149 15:33:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:23.149 15:33:26 -- host/auth.sh@68 -- # digest=sha256 00:32:23.149 15:33:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:23.149 15:33:26 -- host/auth.sh@68 -- # keyid=2 00:32:23.149 15:33:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:23.149 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.149 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:23.149 15:33:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.149 15:33:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:23.149 15:33:26 -- nvmf/common.sh@717 -- # local ip 00:32:23.149 15:33:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:23.149 15:33:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:23.149 15:33:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:23.149 15:33:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:23.149 15:33:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:23.149 15:33:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:23.149 15:33:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:23.149 15:33:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:23.149 15:33:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:23.149 15:33:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:23.149 15:33:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.149 15:33:26 -- common/autotest_common.sh@10 -- # set +x 00:32:23.758 nvme0n1 00:32:23.758 15:33:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.758 15:33:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:23.758 15:33:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.758 15:33:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:23.758 15:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:23.758 15:33:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.758 15:33:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:23.758 15:33:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:23.758 15:33:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.758 15:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:23.758 15:33:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.758 15:33:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:23.758 15:33:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:32:23.758 15:33:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:23.758 15:33:27 -- host/auth.sh@44 -- # digest=sha256 00:32:23.758 15:33:27 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:23.758 15:33:27 -- host/auth.sh@44 -- # keyid=3 00:32:23.758 15:33:27 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:23.758 15:33:27 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:23.758 15:33:27 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:23.758 15:33:27 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:23.758 15:33:27 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:32:23.758 15:33:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:23.758 15:33:27 -- host/auth.sh@68 -- # digest=sha256 00:32:23.758 15:33:27 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:23.758 15:33:27 -- host/auth.sh@68 -- # keyid=3 00:32:23.758 15:33:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:23.758 15:33:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.758 15:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:23.758 15:33:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.758 15:33:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:23.758 15:33:27 -- nvmf/common.sh@717 -- # local ip 00:32:23.758 15:33:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:23.758 15:33:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:23.758 15:33:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:23.758 15:33:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:23.758 15:33:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:23.758 15:33:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:23.758 15:33:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:23.758 15:33:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:23.758 15:33:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:23.758 15:33:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:23.758 15:33:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.758 15:33:27 -- common/autotest_common.sh@10 -- # set +x 00:32:24.327 nvme0n1 00:32:24.327 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.327 15:33:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:24.327 15:33:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:24.327 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.327 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:24.327 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.327 15:33:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:24.327 15:33:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:24.327 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.327 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:24.327 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.327 15:33:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:24.327 15:33:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:32:24.327 15:33:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:24.327 15:33:28 -- host/auth.sh@44 -- # digest=sha256 00:32:24.327 15:33:28 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:24.327 15:33:28 -- host/auth.sh@44 -- # keyid=4 00:32:24.327 15:33:28 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:24.327 15:33:28 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:24.327 15:33:28 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:24.327 15:33:28 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:24.327 15:33:28 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:32:24.327 15:33:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:24.327 15:33:28 -- host/auth.sh@68 -- # digest=sha256 00:32:24.327 15:33:28 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:24.327 15:33:28 -- host/auth.sh@68 -- # keyid=4 00:32:24.327 15:33:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:24.327 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.327 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:24.327 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.327 15:33:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:24.327 15:33:28 -- nvmf/common.sh@717 -- # local ip 00:32:24.327 15:33:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:24.327 15:33:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:24.327 15:33:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:24.327 15:33:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:24.327 15:33:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:24.327 15:33:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:24.327 15:33:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:24.327 15:33:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:24.327 15:33:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:24.327 15:33:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:24.327 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.327 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:24.895 nvme0n1 00:32:24.895 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.895 15:33:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:24.895 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.895 15:33:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:24.895 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:24.895 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.895 15:33:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:24.895 15:33:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:24.895 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.895 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:25.155 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.155 15:33:28 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:25.155 15:33:28 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:25.155 15:33:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.155 15:33:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:32:25.155 15:33:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.155 15:33:28 -- host/auth.sh@44 -- # digest=sha384 00:32:25.155 15:33:28 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.155 15:33:28 -- host/auth.sh@44 -- # keyid=0 00:32:25.155 15:33:28 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:25.155 15:33:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.155 15:33:28 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.155 15:33:28 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:25.155 15:33:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:32:25.155 15:33:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.155 15:33:28 -- host/auth.sh@68 -- # digest=sha384 00:32:25.155 15:33:28 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.155 15:33:28 -- host/auth.sh@68 -- # keyid=0 00:32:25.155 15:33:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.155 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.155 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:25.155 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.155 15:33:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.155 15:33:28 -- nvmf/common.sh@717 -- # local ip 00:32:25.155 15:33:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.155 15:33:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.155 15:33:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.155 15:33:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.155 15:33:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.155 15:33:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.155 15:33:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.155 15:33:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.155 15:33:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.155 15:33:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:25.155 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.155 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:25.155 nvme0n1 00:32:25.155 15:33:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.155 15:33:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.155 15:33:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.155 15:33:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.155 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:32:25.155 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.155 15:33:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.155 15:33:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.155 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.155 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.155 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.155 15:33:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.155 15:33:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:32:25.155 15:33:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.155 15:33:29 -- host/auth.sh@44 -- # digest=sha384 00:32:25.155 15:33:29 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.155 15:33:29 -- host/auth.sh@44 -- # keyid=1 00:32:25.155 15:33:29 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:25.155 15:33:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.155 15:33:29 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.155 15:33:29 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:25.155 15:33:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:32:25.155 15:33:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.155 15:33:29 -- host/auth.sh@68 -- # digest=sha384 00:32:25.155 15:33:29 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.155 15:33:29 -- host/auth.sh@68 -- # keyid=1 00:32:25.155 15:33:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.155 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.155 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.415 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.415 15:33:29 -- nvmf/common.sh@717 -- # local ip 00:32:25.415 15:33:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.415 15:33:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.415 15:33:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.415 15:33:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:25.415 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.415 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.415 nvme0n1 00:32:25.415 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.415 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.415 15:33:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.415 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.415 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.415 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.415 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.415 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.415 15:33:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:32:25.415 15:33:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.415 15:33:29 -- host/auth.sh@44 -- # digest=sha384 00:32:25.415 15:33:29 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.415 15:33:29 -- host/auth.sh@44 -- # keyid=2 00:32:25.415 15:33:29 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:25.415 15:33:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.415 15:33:29 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.415 15:33:29 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:25.415 15:33:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:32:25.415 15:33:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.415 15:33:29 -- host/auth.sh@68 -- # digest=sha384 00:32:25.415 15:33:29 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.415 15:33:29 -- host/auth.sh@68 -- # keyid=2 00:32:25.415 15:33:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.415 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.415 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.415 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.415 15:33:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.415 15:33:29 -- nvmf/common.sh@717 -- # local ip 00:32:25.415 15:33:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.415 15:33:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.415 15:33:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.415 15:33:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.415 15:33:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.415 15:33:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:25.415 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.415 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.675 nvme0n1 00:32:25.675 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.675 15:33:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.675 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.675 15:33:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.675 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.675 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.675 15:33:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.675 15:33:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.675 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.675 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.675 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.675 15:33:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.675 15:33:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:32:25.675 15:33:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.675 15:33:29 -- host/auth.sh@44 -- # digest=sha384 00:32:25.675 15:33:29 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.675 15:33:29 -- host/auth.sh@44 -- # keyid=3 00:32:25.675 15:33:29 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:25.675 15:33:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.675 15:33:29 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.675 15:33:29 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:25.675 15:33:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:32:25.675 15:33:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.675 15:33:29 -- host/auth.sh@68 -- # digest=sha384 00:32:25.675 15:33:29 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.675 15:33:29 -- host/auth.sh@68 -- # keyid=3 00:32:25.675 15:33:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.675 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.675 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.676 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.676 15:33:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.676 15:33:29 -- nvmf/common.sh@717 -- # local ip 00:32:25.676 15:33:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.676 15:33:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.676 15:33:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.676 15:33:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.676 15:33:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.676 15:33:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.676 15:33:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.676 15:33:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.676 15:33:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.676 15:33:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:25.676 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.676 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.935 nvme0n1 00:32:25.935 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.935 15:33:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.935 15:33:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.935 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.935 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.935 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.935 15:33:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.935 15:33:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.935 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.935 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.935 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.935 15:33:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.935 15:33:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:32:25.935 15:33:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.935 15:33:29 -- host/auth.sh@44 -- # digest=sha384 00:32:25.935 15:33:29 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.935 15:33:29 -- host/auth.sh@44 -- # keyid=4 00:32:25.935 15:33:29 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:25.935 15:33:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.935 15:33:29 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.935 15:33:29 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:25.935 15:33:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:32:25.935 15:33:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.935 15:33:29 -- host/auth.sh@68 -- # digest=sha384 00:32:25.935 15:33:29 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.935 15:33:29 -- host/auth.sh@68 -- # keyid=4 00:32:25.935 15:33:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.935 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.935 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:25.935 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.935 15:33:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.935 15:33:29 -- nvmf/common.sh@717 -- # local ip 00:32:25.935 15:33:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.935 15:33:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.935 15:33:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.935 15:33:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.935 15:33:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.935 15:33:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.935 15:33:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.935 15:33:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.935 15:33:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.935 15:33:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:25.935 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.935 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:26.194 nvme0n1 00:32:26.195 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.195 15:33:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.195 15:33:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.195 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.195 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:26.195 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.195 15:33:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.195 15:33:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.195 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.195 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:26.195 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.195 15:33:29 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:26.195 15:33:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.195 15:33:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:32:26.195 15:33:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.195 15:33:29 -- host/auth.sh@44 -- # digest=sha384 00:32:26.195 15:33:29 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.195 15:33:29 -- host/auth.sh@44 -- # keyid=0 00:32:26.195 15:33:29 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:26.195 15:33:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.195 15:33:29 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.195 15:33:29 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:26.195 15:33:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:32:26.195 15:33:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.195 15:33:29 -- host/auth.sh@68 -- # digest=sha384 00:32:26.195 15:33:29 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.195 15:33:29 -- host/auth.sh@68 -- # keyid=0 00:32:26.195 15:33:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.195 15:33:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.195 15:33:29 -- common/autotest_common.sh@10 -- # set +x 00:32:26.195 15:33:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.195 15:33:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.195 15:33:29 -- nvmf/common.sh@717 -- # local ip 00:32:26.195 15:33:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.195 15:33:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.195 15:33:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.195 15:33:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.195 15:33:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.195 15:33:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.195 15:33:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.195 15:33:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.195 15:33:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.195 15:33:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:26.195 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.195 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.454 nvme0n1 00:32:26.454 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.454 15:33:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.454 15:33:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.454 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.454 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.454 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.454 15:33:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.454 15:33:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.454 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.454 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.454 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.454 15:33:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.454 15:33:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:32:26.454 15:33:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.454 15:33:30 -- host/auth.sh@44 -- # digest=sha384 00:32:26.454 15:33:30 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.454 15:33:30 -- host/auth.sh@44 -- # keyid=1 00:32:26.454 15:33:30 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:26.454 15:33:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.454 15:33:30 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.454 15:33:30 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:26.454 15:33:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:32:26.454 15:33:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.454 15:33:30 -- host/auth.sh@68 -- # digest=sha384 00:32:26.454 15:33:30 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.454 15:33:30 -- host/auth.sh@68 -- # keyid=1 00:32:26.454 15:33:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.454 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.454 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.454 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.454 15:33:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.454 15:33:30 -- nvmf/common.sh@717 -- # local ip 00:32:26.454 15:33:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.454 15:33:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.454 15:33:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.454 15:33:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.454 15:33:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.454 15:33:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.454 15:33:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.454 15:33:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.454 15:33:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.454 15:33:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:26.454 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.454 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.713 nvme0n1 00:32:26.713 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.713 15:33:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.713 15:33:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.713 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.713 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.713 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.713 15:33:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.713 15:33:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.713 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.713 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.713 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.713 15:33:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.713 15:33:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:32:26.713 15:33:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.713 15:33:30 -- host/auth.sh@44 -- # digest=sha384 00:32:26.713 15:33:30 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.713 15:33:30 -- host/auth.sh@44 -- # keyid=2 00:32:26.713 15:33:30 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:26.713 15:33:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.713 15:33:30 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.713 15:33:30 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:26.713 15:33:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:32:26.713 15:33:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.713 15:33:30 -- host/auth.sh@68 -- # digest=sha384 00:32:26.713 15:33:30 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.713 15:33:30 -- host/auth.sh@68 -- # keyid=2 00:32:26.713 15:33:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.713 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.713 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.713 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.713 15:33:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.713 15:33:30 -- nvmf/common.sh@717 -- # local ip 00:32:26.713 15:33:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.713 15:33:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.713 15:33:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.713 15:33:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.713 15:33:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.713 15:33:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.713 15:33:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.713 15:33:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.713 15:33:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.713 15:33:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:26.713 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.713 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.972 nvme0n1 00:32:26.972 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.972 15:33:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.972 15:33:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.972 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.972 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.972 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.972 15:33:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.972 15:33:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.972 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.972 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.972 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.972 15:33:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.972 15:33:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:32:26.972 15:33:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.972 15:33:30 -- host/auth.sh@44 -- # digest=sha384 00:32:26.972 15:33:30 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.972 15:33:30 -- host/auth.sh@44 -- # keyid=3 00:32:26.972 15:33:30 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:26.972 15:33:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.972 15:33:30 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.972 15:33:30 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:26.972 15:33:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:32:26.972 15:33:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.972 15:33:30 -- host/auth.sh@68 -- # digest=sha384 00:32:26.972 15:33:30 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.972 15:33:30 -- host/auth.sh@68 -- # keyid=3 00:32:26.972 15:33:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.972 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.972 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:26.972 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.972 15:33:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.972 15:33:30 -- nvmf/common.sh@717 -- # local ip 00:32:26.972 15:33:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.972 15:33:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.972 15:33:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.972 15:33:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.972 15:33:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.972 15:33:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.972 15:33:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.972 15:33:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.972 15:33:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.972 15:33:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:26.972 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.972 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:27.232 nvme0n1 00:32:27.232 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.232 15:33:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.232 15:33:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.232 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.232 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:27.232 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.232 15:33:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.232 15:33:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.232 15:33:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.232 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:32:27.232 15:33:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.232 15:33:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.232 15:33:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:32:27.232 15:33:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.232 15:33:30 -- host/auth.sh@44 -- # digest=sha384 00:32:27.232 15:33:30 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:27.232 15:33:30 -- host/auth.sh@44 -- # keyid=4 00:32:27.232 15:33:31 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:27.232 15:33:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.232 15:33:31 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:27.232 15:33:31 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:27.232 15:33:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:32:27.232 15:33:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.232 15:33:31 -- host/auth.sh@68 -- # digest=sha384 00:32:27.232 15:33:31 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:27.232 15:33:31 -- host/auth.sh@68 -- # keyid=4 00:32:27.232 15:33:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:27.232 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.232 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.232 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.232 15:33:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.232 15:33:31 -- nvmf/common.sh@717 -- # local ip 00:32:27.232 15:33:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.232 15:33:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.232 15:33:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.232 15:33:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.232 15:33:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.232 15:33:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.232 15:33:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.232 15:33:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.232 15:33:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.233 15:33:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:27.233 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.233 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.492 nvme0n1 00:32:27.492 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.492 15:33:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.492 15:33:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.492 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.492 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.492 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.492 15:33:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.492 15:33:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.492 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.492 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.492 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.492 15:33:31 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:27.492 15:33:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.492 15:33:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:32:27.492 15:33:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.492 15:33:31 -- host/auth.sh@44 -- # digest=sha384 00:32:27.492 15:33:31 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:27.492 15:33:31 -- host/auth.sh@44 -- # keyid=0 00:32:27.492 15:33:31 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:27.492 15:33:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.492 15:33:31 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:27.492 15:33:31 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:27.492 15:33:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:32:27.492 15:33:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.492 15:33:31 -- host/auth.sh@68 -- # digest=sha384 00:32:27.492 15:33:31 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:27.492 15:33:31 -- host/auth.sh@68 -- # keyid=0 00:32:27.492 15:33:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:27.492 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.492 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.492 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.492 15:33:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.492 15:33:31 -- nvmf/common.sh@717 -- # local ip 00:32:27.492 15:33:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.492 15:33:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.492 15:33:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.492 15:33:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.492 15:33:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.492 15:33:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.492 15:33:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.492 15:33:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.492 15:33:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.492 15:33:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:27.492 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.492 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.752 nvme0n1 00:32:27.752 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.752 15:33:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.752 15:33:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.752 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.752 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.752 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.752 15:33:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.752 15:33:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.752 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.752 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.752 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.752 15:33:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.752 15:33:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:32:27.752 15:33:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.752 15:33:31 -- host/auth.sh@44 -- # digest=sha384 00:32:27.752 15:33:31 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:27.752 15:33:31 -- host/auth.sh@44 -- # keyid=1 00:32:27.752 15:33:31 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:27.752 15:33:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.752 15:33:31 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:27.752 15:33:31 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:27.752 15:33:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:32:27.752 15:33:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.752 15:33:31 -- host/auth.sh@68 -- # digest=sha384 00:32:27.752 15:33:31 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:27.752 15:33:31 -- host/auth.sh@68 -- # keyid=1 00:32:27.752 15:33:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:27.752 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.752 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:27.752 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.752 15:33:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.752 15:33:31 -- nvmf/common.sh@717 -- # local ip 00:32:27.752 15:33:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.752 15:33:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.752 15:33:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.752 15:33:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.752 15:33:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.752 15:33:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.752 15:33:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.752 15:33:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.752 15:33:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.752 15:33:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:27.752 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.752 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:28.012 nvme0n1 00:32:28.012 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.012 15:33:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.012 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.012 15:33:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.012 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:28.012 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.012 15:33:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.012 15:33:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.012 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.012 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:28.012 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.012 15:33:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.012 15:33:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:32:28.012 15:33:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.012 15:33:31 -- host/auth.sh@44 -- # digest=sha384 00:32:28.012 15:33:31 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.012 15:33:31 -- host/auth.sh@44 -- # keyid=2 00:32:28.012 15:33:31 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:28.012 15:33:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.012 15:33:31 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.012 15:33:31 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:28.012 15:33:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:32:28.012 15:33:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.012 15:33:31 -- host/auth.sh@68 -- # digest=sha384 00:32:28.012 15:33:31 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.012 15:33:31 -- host/auth.sh@68 -- # keyid=2 00:32:28.012 15:33:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.012 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.012 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:28.271 15:33:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.272 15:33:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.272 15:33:31 -- nvmf/common.sh@717 -- # local ip 00:32:28.272 15:33:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.272 15:33:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.272 15:33:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.272 15:33:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.272 15:33:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.272 15:33:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.272 15:33:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.272 15:33:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.272 15:33:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.272 15:33:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:28.272 15:33:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.272 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:32:28.272 nvme0n1 00:32:28.272 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.272 15:33:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.272 15:33:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.272 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.272 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.272 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.531 15:33:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.531 15:33:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.531 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.531 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.531 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.531 15:33:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.531 15:33:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:32:28.531 15:33:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.531 15:33:32 -- host/auth.sh@44 -- # digest=sha384 00:32:28.531 15:33:32 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.531 15:33:32 -- host/auth.sh@44 -- # keyid=3 00:32:28.531 15:33:32 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:28.531 15:33:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.531 15:33:32 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.531 15:33:32 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:28.531 15:33:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:32:28.531 15:33:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.531 15:33:32 -- host/auth.sh@68 -- # digest=sha384 00:32:28.531 15:33:32 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.531 15:33:32 -- host/auth.sh@68 -- # keyid=3 00:32:28.531 15:33:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.531 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.531 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.531 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.531 15:33:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.531 15:33:32 -- nvmf/common.sh@717 -- # local ip 00:32:28.531 15:33:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.531 15:33:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.531 15:33:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.531 15:33:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.531 15:33:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.531 15:33:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.531 15:33:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.531 15:33:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.531 15:33:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.531 15:33:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:28.531 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.531 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.791 nvme0n1 00:32:28.791 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.791 15:33:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.791 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.791 15:33:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.791 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.791 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.791 15:33:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.791 15:33:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.791 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.791 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.791 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.791 15:33:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.791 15:33:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:32:28.791 15:33:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.791 15:33:32 -- host/auth.sh@44 -- # digest=sha384 00:32:28.791 15:33:32 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.791 15:33:32 -- host/auth.sh@44 -- # keyid=4 00:32:28.791 15:33:32 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:28.791 15:33:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.791 15:33:32 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.791 15:33:32 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:28.791 15:33:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:32:28.791 15:33:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.791 15:33:32 -- host/auth.sh@68 -- # digest=sha384 00:32:28.791 15:33:32 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.791 15:33:32 -- host/auth.sh@68 -- # keyid=4 00:32:28.791 15:33:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.791 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.791 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:28.791 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.791 15:33:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.791 15:33:32 -- nvmf/common.sh@717 -- # local ip 00:32:28.791 15:33:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.791 15:33:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.791 15:33:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.791 15:33:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.791 15:33:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.791 15:33:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.791 15:33:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.791 15:33:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.791 15:33:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.791 15:33:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:28.791 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.791 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.050 nvme0n1 00:32:29.050 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.050 15:33:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:29.050 15:33:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:29.050 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.050 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.050 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.050 15:33:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:29.050 15:33:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:29.050 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.050 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.050 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.050 15:33:32 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:29.050 15:33:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:29.050 15:33:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:32:29.050 15:33:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:29.050 15:33:32 -- host/auth.sh@44 -- # digest=sha384 00:32:29.050 15:33:32 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:29.050 15:33:32 -- host/auth.sh@44 -- # keyid=0 00:32:29.050 15:33:32 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:29.050 15:33:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:29.050 15:33:32 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:29.050 15:33:32 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:29.050 15:33:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:32:29.050 15:33:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:29.050 15:33:32 -- host/auth.sh@68 -- # digest=sha384 00:32:29.050 15:33:32 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:29.050 15:33:32 -- host/auth.sh@68 -- # keyid=0 00:32:29.050 15:33:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:29.050 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.050 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.050 15:33:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.050 15:33:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:29.050 15:33:32 -- nvmf/common.sh@717 -- # local ip 00:32:29.050 15:33:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:29.050 15:33:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:29.050 15:33:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:29.050 15:33:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:29.050 15:33:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:29.050 15:33:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:29.050 15:33:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:29.050 15:33:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:29.050 15:33:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:29.050 15:33:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:29.050 15:33:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.050 15:33:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.618 nvme0n1 00:32:29.618 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.618 15:33:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:29.618 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.618 15:33:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:29.618 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.618 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.618 15:33:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:29.618 15:33:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:29.618 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.618 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.618 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.618 15:33:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:29.618 15:33:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:32:29.618 15:33:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:29.618 15:33:33 -- host/auth.sh@44 -- # digest=sha384 00:32:29.618 15:33:33 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:29.618 15:33:33 -- host/auth.sh@44 -- # keyid=1 00:32:29.618 15:33:33 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:29.618 15:33:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:29.618 15:33:33 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:29.618 15:33:33 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:29.618 15:33:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:32:29.618 15:33:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:29.618 15:33:33 -- host/auth.sh@68 -- # digest=sha384 00:32:29.618 15:33:33 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:29.618 15:33:33 -- host/auth.sh@68 -- # keyid=1 00:32:29.618 15:33:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:29.618 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.618 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.618 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.618 15:33:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:29.619 15:33:33 -- nvmf/common.sh@717 -- # local ip 00:32:29.619 15:33:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:29.619 15:33:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:29.619 15:33:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:29.619 15:33:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:29.619 15:33:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:29.619 15:33:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:29.619 15:33:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:29.619 15:33:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:29.619 15:33:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:29.619 15:33:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:29.619 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.619 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.879 nvme0n1 00:32:29.879 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.879 15:33:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:29.879 15:33:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:29.879 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.879 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.879 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.879 15:33:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:29.879 15:33:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:29.879 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.879 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.879 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.879 15:33:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:29.879 15:33:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:32:29.879 15:33:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:29.879 15:33:33 -- host/auth.sh@44 -- # digest=sha384 00:32:29.879 15:33:33 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:29.879 15:33:33 -- host/auth.sh@44 -- # keyid=2 00:32:29.879 15:33:33 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:29.879 15:33:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:29.879 15:33:33 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:29.879 15:33:33 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:29.879 15:33:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:32:29.879 15:33:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:29.879 15:33:33 -- host/auth.sh@68 -- # digest=sha384 00:32:29.879 15:33:33 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:29.879 15:33:33 -- host/auth.sh@68 -- # keyid=2 00:32:29.879 15:33:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:29.879 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.879 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:29.879 15:33:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.879 15:33:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:29.879 15:33:33 -- nvmf/common.sh@717 -- # local ip 00:32:29.879 15:33:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:29.879 15:33:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:29.879 15:33:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:29.879 15:33:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:29.879 15:33:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:29.879 15:33:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:29.879 15:33:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:29.879 15:33:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:29.879 15:33:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:29.879 15:33:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:29.879 15:33:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.879 15:33:33 -- common/autotest_common.sh@10 -- # set +x 00:32:30.448 nvme0n1 00:32:30.448 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.448 15:33:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:30.448 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.448 15:33:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:30.448 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.448 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.448 15:33:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:30.448 15:33:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:30.448 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.448 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.448 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.448 15:33:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:30.448 15:33:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:32:30.448 15:33:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:30.448 15:33:34 -- host/auth.sh@44 -- # digest=sha384 00:32:30.448 15:33:34 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:30.448 15:33:34 -- host/auth.sh@44 -- # keyid=3 00:32:30.448 15:33:34 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:30.448 15:33:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:30.448 15:33:34 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:30.448 15:33:34 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:30.448 15:33:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:32:30.448 15:33:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:30.448 15:33:34 -- host/auth.sh@68 -- # digest=sha384 00:32:30.448 15:33:34 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:30.448 15:33:34 -- host/auth.sh@68 -- # keyid=3 00:32:30.448 15:33:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:30.448 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.448 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.448 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.448 15:33:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:30.448 15:33:34 -- nvmf/common.sh@717 -- # local ip 00:32:30.448 15:33:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:30.448 15:33:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:30.448 15:33:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:30.448 15:33:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:30.448 15:33:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:30.448 15:33:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:30.448 15:33:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:30.448 15:33:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:30.448 15:33:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:30.448 15:33:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:30.448 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.448 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.707 nvme0n1 00:32:30.707 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.707 15:33:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:30.707 15:33:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:30.707 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.707 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.707 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.967 15:33:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:30.967 15:33:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:30.967 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.967 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.967 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.967 15:33:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:30.967 15:33:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:32:30.967 15:33:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:30.967 15:33:34 -- host/auth.sh@44 -- # digest=sha384 00:32:30.967 15:33:34 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:30.967 15:33:34 -- host/auth.sh@44 -- # keyid=4 00:32:30.967 15:33:34 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:30.967 15:33:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:30.967 15:33:34 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:30.967 15:33:34 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:30.967 15:33:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:32:30.967 15:33:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:30.967 15:33:34 -- host/auth.sh@68 -- # digest=sha384 00:32:30.967 15:33:34 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:30.967 15:33:34 -- host/auth.sh@68 -- # keyid=4 00:32:30.967 15:33:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:30.967 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.967 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:30.967 15:33:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.967 15:33:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:30.967 15:33:34 -- nvmf/common.sh@717 -- # local ip 00:32:30.967 15:33:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:30.967 15:33:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:30.967 15:33:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:30.967 15:33:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:30.967 15:33:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:30.967 15:33:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:30.967 15:33:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:30.967 15:33:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:30.967 15:33:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:30.967 15:33:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:30.967 15:33:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.967 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:32:31.226 nvme0n1 00:32:31.227 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.227 15:33:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:31.227 15:33:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:31.227 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.227 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:31.227 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.227 15:33:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:31.227 15:33:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:31.227 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.227 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:31.227 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.227 15:33:35 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:31.227 15:33:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:31.227 15:33:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:32:31.227 15:33:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:31.227 15:33:35 -- host/auth.sh@44 -- # digest=sha384 00:32:31.227 15:33:35 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:31.227 15:33:35 -- host/auth.sh@44 -- # keyid=0 00:32:31.227 15:33:35 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:31.227 15:33:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:31.227 15:33:35 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:31.227 15:33:35 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:31.227 15:33:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:32:31.227 15:33:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:31.227 15:33:35 -- host/auth.sh@68 -- # digest=sha384 00:32:31.227 15:33:35 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:31.227 15:33:35 -- host/auth.sh@68 -- # keyid=0 00:32:31.227 15:33:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:31.227 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.227 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:31.227 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.227 15:33:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:31.227 15:33:35 -- nvmf/common.sh@717 -- # local ip 00:32:31.227 15:33:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:31.227 15:33:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:31.227 15:33:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:31.227 15:33:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:31.227 15:33:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:31.227 15:33:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:31.227 15:33:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:31.227 15:33:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:31.227 15:33:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:31.227 15:33:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:31.227 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.227 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:31.796 nvme0n1 00:32:31.796 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.796 15:33:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:31.796 15:33:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:31.796 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.796 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:31.796 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.055 15:33:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:32.055 15:33:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:32.055 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.055 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:32.055 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.055 15:33:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:32.055 15:33:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:32:32.056 15:33:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:32.056 15:33:35 -- host/auth.sh@44 -- # digest=sha384 00:32:32.056 15:33:35 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:32.056 15:33:35 -- host/auth.sh@44 -- # keyid=1 00:32:32.056 15:33:35 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:32.056 15:33:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:32.056 15:33:35 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:32.056 15:33:35 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:32.056 15:33:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:32:32.056 15:33:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:32.056 15:33:35 -- host/auth.sh@68 -- # digest=sha384 00:32:32.056 15:33:35 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:32.056 15:33:35 -- host/auth.sh@68 -- # keyid=1 00:32:32.056 15:33:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:32.056 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.056 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:32.056 15:33:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.056 15:33:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:32.056 15:33:35 -- nvmf/common.sh@717 -- # local ip 00:32:32.056 15:33:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:32.056 15:33:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:32.056 15:33:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:32.056 15:33:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:32.056 15:33:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:32.056 15:33:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:32.056 15:33:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:32.056 15:33:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:32.056 15:33:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:32.056 15:33:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:32.056 15:33:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.056 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:32:32.624 nvme0n1 00:32:32.624 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.624 15:33:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:32.624 15:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.624 15:33:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:32.624 15:33:36 -- common/autotest_common.sh@10 -- # set +x 00:32:32.624 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.624 15:33:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:32.624 15:33:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:32.624 15:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.624 15:33:36 -- common/autotest_common.sh@10 -- # set +x 00:32:32.624 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.624 15:33:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:32.624 15:33:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:32:32.624 15:33:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:32.624 15:33:36 -- host/auth.sh@44 -- # digest=sha384 00:32:32.624 15:33:36 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:32.624 15:33:36 -- host/auth.sh@44 -- # keyid=2 00:32:32.624 15:33:36 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:32.624 15:33:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:32.624 15:33:36 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:32.624 15:33:36 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:32.625 15:33:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:32:32.625 15:33:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:32.625 15:33:36 -- host/auth.sh@68 -- # digest=sha384 00:32:32.625 15:33:36 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:32.625 15:33:36 -- host/auth.sh@68 -- # keyid=2 00:32:32.625 15:33:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:32.625 15:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.625 15:33:36 -- common/autotest_common.sh@10 -- # set +x 00:32:32.625 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.625 15:33:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:32.625 15:33:36 -- nvmf/common.sh@717 -- # local ip 00:32:32.625 15:33:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:32.625 15:33:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:32.625 15:33:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:32.625 15:33:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:32.625 15:33:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:32.625 15:33:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:32.625 15:33:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:32.625 15:33:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:32.625 15:33:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:32.625 15:33:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:32.625 15:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.625 15:33:36 -- common/autotest_common.sh@10 -- # set +x 00:32:33.194 nvme0n1 00:32:33.194 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.194 15:33:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:33.194 15:33:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:33.194 15:33:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.194 15:33:36 -- common/autotest_common.sh@10 -- # set +x 00:32:33.194 15:33:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.194 15:33:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:33.194 15:33:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:33.194 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.194 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:33.194 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.194 15:33:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:33.194 15:33:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:32:33.194 15:33:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:33.194 15:33:37 -- host/auth.sh@44 -- # digest=sha384 00:32:33.194 15:33:37 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:33.194 15:33:37 -- host/auth.sh@44 -- # keyid=3 00:32:33.194 15:33:37 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:33.194 15:33:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:33.194 15:33:37 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:33.194 15:33:37 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:33.194 15:33:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:32:33.194 15:33:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:33.194 15:33:37 -- host/auth.sh@68 -- # digest=sha384 00:32:33.194 15:33:37 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:33.194 15:33:37 -- host/auth.sh@68 -- # keyid=3 00:32:33.194 15:33:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:33.194 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.194 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:33.194 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.194 15:33:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:33.194 15:33:37 -- nvmf/common.sh@717 -- # local ip 00:32:33.194 15:33:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:33.194 15:33:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:33.194 15:33:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:33.194 15:33:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:33.194 15:33:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:33.194 15:33:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:33.194 15:33:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:33.194 15:33:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:33.194 15:33:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:33.194 15:33:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:33.194 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.194 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:33.763 nvme0n1 00:32:33.763 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.763 15:33:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:33.763 15:33:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:33.763 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.763 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:33.763 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.763 15:33:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:33.763 15:33:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:33.763 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.763 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:34.023 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.023 15:33:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.023 15:33:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:32:34.023 15:33:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.023 15:33:37 -- host/auth.sh@44 -- # digest=sha384 00:32:34.023 15:33:37 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:34.023 15:33:37 -- host/auth.sh@44 -- # keyid=4 00:32:34.023 15:33:37 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:34.023 15:33:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:34.023 15:33:37 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:34.023 15:33:37 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:34.023 15:33:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:32:34.023 15:33:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.023 15:33:37 -- host/auth.sh@68 -- # digest=sha384 00:32:34.023 15:33:37 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:34.023 15:33:37 -- host/auth.sh@68 -- # keyid=4 00:32:34.023 15:33:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:34.023 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.023 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:34.023 15:33:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.023 15:33:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.023 15:33:37 -- nvmf/common.sh@717 -- # local ip 00:32:34.023 15:33:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.023 15:33:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.023 15:33:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.023 15:33:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.023 15:33:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.023 15:33:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.023 15:33:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.023 15:33:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.023 15:33:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.023 15:33:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:34.023 15:33:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.023 15:33:37 -- common/autotest_common.sh@10 -- # set +x 00:32:34.590 nvme0n1 00:32:34.590 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.590 15:33:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.590 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.590 15:33:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.590 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.590 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.590 15:33:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.590 15:33:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.590 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.590 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.590 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.590 15:33:38 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:34.590 15:33:38 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:34.590 15:33:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.590 15:33:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:32:34.590 15:33:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.590 15:33:38 -- host/auth.sh@44 -- # digest=sha512 00:32:34.590 15:33:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.590 15:33:38 -- host/auth.sh@44 -- # keyid=0 00:32:34.590 15:33:38 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:34.590 15:33:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.590 15:33:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.590 15:33:38 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:34.590 15:33:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:32:34.590 15:33:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.590 15:33:38 -- host/auth.sh@68 -- # digest=sha512 00:32:34.590 15:33:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.590 15:33:38 -- host/auth.sh@68 -- # keyid=0 00:32:34.590 15:33:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.590 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.590 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.590 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.590 15:33:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.590 15:33:38 -- nvmf/common.sh@717 -- # local ip 00:32:34.590 15:33:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.590 15:33:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.591 15:33:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.591 15:33:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.591 15:33:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.591 15:33:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.591 15:33:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.591 15:33:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.591 15:33:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.591 15:33:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:34.591 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.591 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.591 nvme0n1 00:32:34.591 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.850 15:33:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.850 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.850 15:33:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.850 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.850 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.850 15:33:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.850 15:33:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.850 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.850 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.850 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.850 15:33:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.850 15:33:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:32:34.850 15:33:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.850 15:33:38 -- host/auth.sh@44 -- # digest=sha512 00:32:34.850 15:33:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.850 15:33:38 -- host/auth.sh@44 -- # keyid=1 00:32:34.850 15:33:38 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:34.850 15:33:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.850 15:33:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.850 15:33:38 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:34.850 15:33:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:32:34.850 15:33:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.850 15:33:38 -- host/auth.sh@68 -- # digest=sha512 00:32:34.850 15:33:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.850 15:33:38 -- host/auth.sh@68 -- # keyid=1 00:32:34.850 15:33:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.850 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.850 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.850 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.850 15:33:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.850 15:33:38 -- nvmf/common.sh@717 -- # local ip 00:32:34.850 15:33:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.850 15:33:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.850 15:33:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.850 15:33:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.850 15:33:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.850 15:33:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.850 15:33:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.850 15:33:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.850 15:33:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.850 15:33:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:34.850 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.850 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.851 nvme0n1 00:32:34.851 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.851 15:33:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.851 15:33:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.851 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.851 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:34.851 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.110 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.110 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.110 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.110 15:33:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:32:35.110 15:33:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.110 15:33:38 -- host/auth.sh@44 -- # digest=sha512 00:32:35.110 15:33:38 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:35.110 15:33:38 -- host/auth.sh@44 -- # keyid=2 00:32:35.110 15:33:38 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:35.110 15:33:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.110 15:33:38 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:35.110 15:33:38 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:35.110 15:33:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:32:35.110 15:33:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.110 15:33:38 -- host/auth.sh@68 -- # digest=sha512 00:32:35.110 15:33:38 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:35.110 15:33:38 -- host/auth.sh@68 -- # keyid=2 00:32:35.110 15:33:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:35.110 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.110 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.110 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.110 15:33:38 -- nvmf/common.sh@717 -- # local ip 00:32:35.110 15:33:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.110 15:33:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.110 15:33:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.110 15:33:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.110 15:33:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.110 15:33:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.110 15:33:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.110 15:33:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.110 15:33:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.110 15:33:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:35.110 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.110 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.110 nvme0n1 00:32:35.110 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.110 15:33:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.110 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.110 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.110 15:33:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.110 15:33:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.110 15:33:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.110 15:33:38 -- common/autotest_common.sh@10 -- # set +x 00:32:35.369 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.369 15:33:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.369 15:33:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:32:35.369 15:33:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.369 15:33:39 -- host/auth.sh@44 -- # digest=sha512 00:32:35.369 15:33:39 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:35.369 15:33:39 -- host/auth.sh@44 -- # keyid=3 00:32:35.369 15:33:39 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:35.369 15:33:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.369 15:33:39 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:35.369 15:33:39 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:35.369 15:33:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:32:35.369 15:33:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.369 15:33:39 -- host/auth.sh@68 -- # digest=sha512 00:32:35.370 15:33:39 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:35.370 15:33:39 -- host/auth.sh@68 -- # keyid=3 00:32:35.370 15:33:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.370 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.370 15:33:39 -- nvmf/common.sh@717 -- # local ip 00:32:35.370 15:33:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.370 15:33:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.370 15:33:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.370 15:33:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.370 nvme0n1 00:32:35.370 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.370 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.370 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.370 15:33:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:32:35.370 15:33:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.370 15:33:39 -- host/auth.sh@44 -- # digest=sha512 00:32:35.370 15:33:39 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:35.370 15:33:39 -- host/auth.sh@44 -- # keyid=4 00:32:35.370 15:33:39 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:35.370 15:33:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.370 15:33:39 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:35.370 15:33:39 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:35.370 15:33:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:32:35.370 15:33:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.370 15:33:39 -- host/auth.sh@68 -- # digest=sha512 00:32:35.370 15:33:39 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:35.370 15:33:39 -- host/auth.sh@68 -- # keyid=4 00:32:35.370 15:33:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.370 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.370 15:33:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.370 15:33:39 -- nvmf/common.sh@717 -- # local ip 00:32:35.370 15:33:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.370 15:33:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.370 15:33:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.370 15:33:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.370 15:33:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.370 15:33:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:35.370 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.370 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.629 nvme0n1 00:32:35.629 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.629 15:33:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.629 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.629 15:33:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.629 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.629 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.630 15:33:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.630 15:33:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.630 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.630 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.630 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.630 15:33:39 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:35.630 15:33:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.630 15:33:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:32:35.630 15:33:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.630 15:33:39 -- host/auth.sh@44 -- # digest=sha512 00:32:35.630 15:33:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:35.630 15:33:39 -- host/auth.sh@44 -- # keyid=0 00:32:35.630 15:33:39 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:35.630 15:33:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.630 15:33:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:35.630 15:33:39 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:35.630 15:33:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:32:35.630 15:33:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.630 15:33:39 -- host/auth.sh@68 -- # digest=sha512 00:32:35.630 15:33:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:35.630 15:33:39 -- host/auth.sh@68 -- # keyid=0 00:32:35.630 15:33:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:35.630 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.630 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.630 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.630 15:33:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.630 15:33:39 -- nvmf/common.sh@717 -- # local ip 00:32:35.630 15:33:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.630 15:33:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.630 15:33:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.630 15:33:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.630 15:33:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.630 15:33:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.630 15:33:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.630 15:33:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.630 15:33:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.630 15:33:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:35.630 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.630 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.888 nvme0n1 00:32:35.888 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.888 15:33:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.888 15:33:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.889 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.889 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.889 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.889 15:33:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.889 15:33:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.889 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.889 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.889 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.889 15:33:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.889 15:33:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:32:35.889 15:33:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.889 15:33:39 -- host/auth.sh@44 -- # digest=sha512 00:32:35.889 15:33:39 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:35.889 15:33:39 -- host/auth.sh@44 -- # keyid=1 00:32:35.889 15:33:39 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:35.889 15:33:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.889 15:33:39 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:35.889 15:33:39 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:35.889 15:33:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:32:35.889 15:33:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.889 15:33:39 -- host/auth.sh@68 -- # digest=sha512 00:32:35.889 15:33:39 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:35.889 15:33:39 -- host/auth.sh@68 -- # keyid=1 00:32:35.889 15:33:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:35.889 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.889 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:35.889 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.889 15:33:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.889 15:33:39 -- nvmf/common.sh@717 -- # local ip 00:32:35.889 15:33:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.889 15:33:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.889 15:33:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.889 15:33:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.889 15:33:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.889 15:33:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.889 15:33:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.889 15:33:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.889 15:33:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.889 15:33:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:35.889 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.889 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:36.148 nvme0n1 00:32:36.148 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.148 15:33:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.148 15:33:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.148 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.148 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:36.148 15:33:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.148 15:33:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.148 15:33:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.148 15:33:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.148 15:33:39 -- common/autotest_common.sh@10 -- # set +x 00:32:36.148 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.148 15:33:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.148 15:33:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:32:36.148 15:33:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.148 15:33:40 -- host/auth.sh@44 -- # digest=sha512 00:32:36.148 15:33:40 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:36.148 15:33:40 -- host/auth.sh@44 -- # keyid=2 00:32:36.148 15:33:40 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:36.148 15:33:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.148 15:33:40 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:36.148 15:33:40 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:36.148 15:33:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:32:36.148 15:33:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.148 15:33:40 -- host/auth.sh@68 -- # digest=sha512 00:32:36.148 15:33:40 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:36.148 15:33:40 -- host/auth.sh@68 -- # keyid=2 00:32:36.148 15:33:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:36.148 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.148 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.148 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.148 15:33:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.148 15:33:40 -- nvmf/common.sh@717 -- # local ip 00:32:36.148 15:33:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.148 15:33:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.148 15:33:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.148 15:33:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.148 15:33:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.148 15:33:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.148 15:33:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.148 15:33:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.148 15:33:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.148 15:33:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:36.148 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.148 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.407 nvme0n1 00:32:36.407 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.407 15:33:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.407 15:33:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.407 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.407 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.407 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.407 15:33:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.408 15:33:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.408 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.408 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.408 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.408 15:33:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.408 15:33:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:32:36.408 15:33:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.408 15:33:40 -- host/auth.sh@44 -- # digest=sha512 00:32:36.408 15:33:40 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:36.408 15:33:40 -- host/auth.sh@44 -- # keyid=3 00:32:36.408 15:33:40 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:36.408 15:33:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.408 15:33:40 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:36.408 15:33:40 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:36.408 15:33:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:32:36.408 15:33:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.408 15:33:40 -- host/auth.sh@68 -- # digest=sha512 00:32:36.408 15:33:40 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:36.408 15:33:40 -- host/auth.sh@68 -- # keyid=3 00:32:36.408 15:33:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:36.408 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.408 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.408 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.408 15:33:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.408 15:33:40 -- nvmf/common.sh@717 -- # local ip 00:32:36.408 15:33:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.408 15:33:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.408 15:33:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.408 15:33:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.408 15:33:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.408 15:33:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.408 15:33:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.408 15:33:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.408 15:33:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.408 15:33:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:36.408 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.408 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.667 nvme0n1 00:32:36.667 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.667 15:33:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.667 15:33:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.667 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.667 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.667 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.667 15:33:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.667 15:33:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.667 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.667 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.667 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.667 15:33:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.667 15:33:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:32:36.667 15:33:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.667 15:33:40 -- host/auth.sh@44 -- # digest=sha512 00:32:36.667 15:33:40 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:36.667 15:33:40 -- host/auth.sh@44 -- # keyid=4 00:32:36.667 15:33:40 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:36.667 15:33:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.667 15:33:40 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:36.667 15:33:40 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:36.667 15:33:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:32:36.667 15:33:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.667 15:33:40 -- host/auth.sh@68 -- # digest=sha512 00:32:36.667 15:33:40 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:36.667 15:33:40 -- host/auth.sh@68 -- # keyid=4 00:32:36.667 15:33:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:36.667 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.667 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.667 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.667 15:33:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.667 15:33:40 -- nvmf/common.sh@717 -- # local ip 00:32:36.667 15:33:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.667 15:33:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.667 15:33:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.667 15:33:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.667 15:33:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.667 15:33:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.667 15:33:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.667 15:33:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.667 15:33:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.667 15:33:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:36.667 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.667 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.927 nvme0n1 00:32:36.927 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.927 15:33:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.927 15:33:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.927 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.927 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.927 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.927 15:33:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.927 15:33:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.927 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.927 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.927 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.927 15:33:40 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:36.927 15:33:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.927 15:33:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:32:36.927 15:33:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.927 15:33:40 -- host/auth.sh@44 -- # digest=sha512 00:32:36.927 15:33:40 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:36.927 15:33:40 -- host/auth.sh@44 -- # keyid=0 00:32:36.927 15:33:40 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:36.927 15:33:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.927 15:33:40 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:36.927 15:33:40 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:36.927 15:33:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:32:36.927 15:33:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.927 15:33:40 -- host/auth.sh@68 -- # digest=sha512 00:32:36.927 15:33:40 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:36.927 15:33:40 -- host/auth.sh@68 -- # keyid=0 00:32:36.927 15:33:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:36.927 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.927 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.927 15:33:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.927 15:33:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.927 15:33:40 -- nvmf/common.sh@717 -- # local ip 00:32:36.927 15:33:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.927 15:33:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.927 15:33:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.927 15:33:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.927 15:33:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.927 15:33:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.927 15:33:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.927 15:33:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.927 15:33:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.927 15:33:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:36.927 15:33:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.927 15:33:40 -- common/autotest_common.sh@10 -- # set +x 00:32:37.186 nvme0n1 00:32:37.186 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.186 15:33:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.186 15:33:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.186 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.186 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.186 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.186 15:33:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.186 15:33:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.186 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.186 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.186 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.186 15:33:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.186 15:33:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:32:37.186 15:33:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.186 15:33:41 -- host/auth.sh@44 -- # digest=sha512 00:32:37.186 15:33:41 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.186 15:33:41 -- host/auth.sh@44 -- # keyid=1 00:32:37.186 15:33:41 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:37.186 15:33:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.186 15:33:41 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.446 15:33:41 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:37.446 15:33:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:32:37.446 15:33:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.446 15:33:41 -- host/auth.sh@68 -- # digest=sha512 00:32:37.446 15:33:41 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.446 15:33:41 -- host/auth.sh@68 -- # keyid=1 00:32:37.446 15:33:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.446 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.446 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.446 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.446 15:33:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.446 15:33:41 -- nvmf/common.sh@717 -- # local ip 00:32:37.446 15:33:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.446 15:33:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.446 15:33:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.446 15:33:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.446 15:33:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.446 15:33:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.446 15:33:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.446 15:33:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.446 15:33:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.446 15:33:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:37.446 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.446 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.707 nvme0n1 00:32:37.707 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.707 15:33:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.707 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.707 15:33:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.707 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.707 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.707 15:33:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.707 15:33:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.707 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.707 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.707 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.707 15:33:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.707 15:33:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:32:37.707 15:33:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.707 15:33:41 -- host/auth.sh@44 -- # digest=sha512 00:32:37.707 15:33:41 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.707 15:33:41 -- host/auth.sh@44 -- # keyid=2 00:32:37.707 15:33:41 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:37.707 15:33:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.707 15:33:41 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.707 15:33:41 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:37.707 15:33:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:32:37.707 15:33:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.707 15:33:41 -- host/auth.sh@68 -- # digest=sha512 00:32:37.707 15:33:41 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.707 15:33:41 -- host/auth.sh@68 -- # keyid=2 00:32:37.707 15:33:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.707 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.707 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.707 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.707 15:33:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.707 15:33:41 -- nvmf/common.sh@717 -- # local ip 00:32:37.707 15:33:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.707 15:33:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.707 15:33:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.707 15:33:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.707 15:33:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.707 15:33:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.707 15:33:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.707 15:33:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.707 15:33:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.707 15:33:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:37.707 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.707 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.966 nvme0n1 00:32:37.966 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.966 15:33:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.966 15:33:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.966 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.966 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.966 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.966 15:33:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.966 15:33:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.966 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.967 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.967 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.967 15:33:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.967 15:33:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:32:37.967 15:33:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.967 15:33:41 -- host/auth.sh@44 -- # digest=sha512 00:32:37.967 15:33:41 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.967 15:33:41 -- host/auth.sh@44 -- # keyid=3 00:32:37.967 15:33:41 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:37.967 15:33:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.967 15:33:41 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.967 15:33:41 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:37.967 15:33:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:32:37.967 15:33:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.967 15:33:41 -- host/auth.sh@68 -- # digest=sha512 00:32:37.967 15:33:41 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.967 15:33:41 -- host/auth.sh@68 -- # keyid=3 00:32:37.967 15:33:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.967 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.967 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:37.967 15:33:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.967 15:33:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.967 15:33:41 -- nvmf/common.sh@717 -- # local ip 00:32:37.967 15:33:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.967 15:33:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.967 15:33:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.967 15:33:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.967 15:33:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.967 15:33:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.967 15:33:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.967 15:33:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.967 15:33:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.967 15:33:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:37.967 15:33:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.967 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:32:38.226 nvme0n1 00:32:38.226 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.226 15:33:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:38.226 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.226 15:33:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:38.226 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.226 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.226 15:33:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:38.226 15:33:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:38.226 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.226 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.226 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.226 15:33:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:38.226 15:33:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:32:38.226 15:33:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:38.226 15:33:42 -- host/auth.sh@44 -- # digest=sha512 00:32:38.226 15:33:42 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:38.226 15:33:42 -- host/auth.sh@44 -- # keyid=4 00:32:38.226 15:33:42 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:38.226 15:33:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:38.226 15:33:42 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:38.226 15:33:42 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:38.226 15:33:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:32:38.226 15:33:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:38.226 15:33:42 -- host/auth.sh@68 -- # digest=sha512 00:32:38.226 15:33:42 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:38.226 15:33:42 -- host/auth.sh@68 -- # keyid=4 00:32:38.226 15:33:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:38.226 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.226 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.226 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.226 15:33:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:38.226 15:33:42 -- nvmf/common.sh@717 -- # local ip 00:32:38.226 15:33:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:38.226 15:33:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:38.226 15:33:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:38.226 15:33:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:38.226 15:33:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:38.226 15:33:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:38.226 15:33:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:38.226 15:33:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:38.226 15:33:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:38.226 15:33:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:38.226 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.226 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.485 nvme0n1 00:32:38.486 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.486 15:33:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:38.486 15:33:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:38.486 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.486 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.486 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.745 15:33:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:38.745 15:33:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:38.745 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.745 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.745 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.745 15:33:42 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:38.745 15:33:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:38.745 15:33:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:32:38.745 15:33:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:38.745 15:33:42 -- host/auth.sh@44 -- # digest=sha512 00:32:38.745 15:33:42 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:38.745 15:33:42 -- host/auth.sh@44 -- # keyid=0 00:32:38.745 15:33:42 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:38.745 15:33:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:38.745 15:33:42 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:38.745 15:33:42 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:38.745 15:33:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:32:38.745 15:33:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:38.745 15:33:42 -- host/auth.sh@68 -- # digest=sha512 00:32:38.745 15:33:42 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:38.745 15:33:42 -- host/auth.sh@68 -- # keyid=0 00:32:38.745 15:33:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:38.745 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.745 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:38.745 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.745 15:33:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:38.745 15:33:42 -- nvmf/common.sh@717 -- # local ip 00:32:38.745 15:33:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:38.745 15:33:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:38.745 15:33:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:38.745 15:33:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:38.745 15:33:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:38.745 15:33:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:38.745 15:33:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:38.745 15:33:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:38.745 15:33:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:38.745 15:33:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:38.745 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.745 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:39.005 nvme0n1 00:32:39.005 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.005 15:33:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.005 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.005 15:33:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.005 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:39.005 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.005 15:33:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.005 15:33:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.005 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.005 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:39.005 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.005 15:33:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:39.005 15:33:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:32:39.005 15:33:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:39.005 15:33:42 -- host/auth.sh@44 -- # digest=sha512 00:32:39.005 15:33:42 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:39.005 15:33:42 -- host/auth.sh@44 -- # keyid=1 00:32:39.005 15:33:42 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:39.005 15:33:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:39.005 15:33:42 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:39.005 15:33:42 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:39.005 15:33:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:32:39.005 15:33:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:39.005 15:33:42 -- host/auth.sh@68 -- # digest=sha512 00:32:39.005 15:33:42 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:39.005 15:33:42 -- host/auth.sh@68 -- # keyid=1 00:32:39.005 15:33:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:39.005 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.005 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:39.005 15:33:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.005 15:33:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:39.005 15:33:42 -- nvmf/common.sh@717 -- # local ip 00:32:39.005 15:33:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:39.005 15:33:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:39.005 15:33:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:39.005 15:33:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:39.005 15:33:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:39.005 15:33:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:39.005 15:33:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:39.005 15:33:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:39.005 15:33:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:39.005 15:33:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:39.005 15:33:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.005 15:33:42 -- common/autotest_common.sh@10 -- # set +x 00:32:39.574 nvme0n1 00:32:39.574 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.574 15:33:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.574 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.574 15:33:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.574 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:39.574 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.574 15:33:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.574 15:33:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.574 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.574 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:39.574 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.574 15:33:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:39.574 15:33:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:32:39.574 15:33:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:39.574 15:33:43 -- host/auth.sh@44 -- # digest=sha512 00:32:39.574 15:33:43 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:39.574 15:33:43 -- host/auth.sh@44 -- # keyid=2 00:32:39.574 15:33:43 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:39.574 15:33:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:39.574 15:33:43 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:39.574 15:33:43 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:39.574 15:33:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:32:39.574 15:33:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:39.574 15:33:43 -- host/auth.sh@68 -- # digest=sha512 00:32:39.574 15:33:43 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:39.574 15:33:43 -- host/auth.sh@68 -- # keyid=2 00:32:39.574 15:33:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:39.574 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.574 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:39.574 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.574 15:33:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:39.574 15:33:43 -- nvmf/common.sh@717 -- # local ip 00:32:39.574 15:33:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:39.574 15:33:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:39.574 15:33:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:39.574 15:33:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:39.574 15:33:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:39.574 15:33:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:39.574 15:33:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:39.574 15:33:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:39.574 15:33:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:39.574 15:33:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:39.574 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.574 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:39.833 nvme0n1 00:32:39.833 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.833 15:33:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.833 15:33:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.833 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.833 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:39.833 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.833 15:33:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.833 15:33:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.833 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.833 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:40.093 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.093 15:33:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:40.093 15:33:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:32:40.093 15:33:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:40.093 15:33:43 -- host/auth.sh@44 -- # digest=sha512 00:32:40.093 15:33:43 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:40.093 15:33:43 -- host/auth.sh@44 -- # keyid=3 00:32:40.093 15:33:43 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:40.093 15:33:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:40.093 15:33:43 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:40.093 15:33:43 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:40.093 15:33:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:32:40.093 15:33:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:40.093 15:33:43 -- host/auth.sh@68 -- # digest=sha512 00:32:40.093 15:33:43 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:40.093 15:33:43 -- host/auth.sh@68 -- # keyid=3 00:32:40.093 15:33:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:40.093 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.093 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:40.093 15:33:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.093 15:33:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:40.093 15:33:43 -- nvmf/common.sh@717 -- # local ip 00:32:40.093 15:33:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:40.093 15:33:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:40.093 15:33:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:40.093 15:33:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:40.093 15:33:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:40.093 15:33:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:40.093 15:33:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:40.093 15:33:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:40.093 15:33:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:40.093 15:33:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:40.093 15:33:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.093 15:33:43 -- common/autotest_common.sh@10 -- # set +x 00:32:40.353 nvme0n1 00:32:40.353 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.353 15:33:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:40.353 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.353 15:33:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:40.353 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.353 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.353 15:33:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:40.353 15:33:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:40.353 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.353 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.353 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.353 15:33:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:40.353 15:33:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:32:40.353 15:33:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:40.353 15:33:44 -- host/auth.sh@44 -- # digest=sha512 00:32:40.353 15:33:44 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:40.353 15:33:44 -- host/auth.sh@44 -- # keyid=4 00:32:40.353 15:33:44 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:40.353 15:33:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:40.353 15:33:44 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:40.353 15:33:44 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:40.353 15:33:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:32:40.353 15:33:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:40.353 15:33:44 -- host/auth.sh@68 -- # digest=sha512 00:32:40.353 15:33:44 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:40.353 15:33:44 -- host/auth.sh@68 -- # keyid=4 00:32:40.353 15:33:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:40.353 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.353 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.353 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.353 15:33:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:40.353 15:33:44 -- nvmf/common.sh@717 -- # local ip 00:32:40.353 15:33:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:40.353 15:33:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:40.353 15:33:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:40.353 15:33:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:40.353 15:33:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:40.353 15:33:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:40.353 15:33:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:40.353 15:33:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:40.353 15:33:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:40.353 15:33:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:40.353 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.353 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.921 nvme0n1 00:32:40.921 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.921 15:33:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:40.921 15:33:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:40.921 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.921 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.922 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.922 15:33:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:40.922 15:33:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:40.922 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.922 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.922 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.922 15:33:44 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:40.922 15:33:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:40.922 15:33:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:32:40.922 15:33:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:40.922 15:33:44 -- host/auth.sh@44 -- # digest=sha512 00:32:40.922 15:33:44 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:40.922 15:33:44 -- host/auth.sh@44 -- # keyid=0 00:32:40.922 15:33:44 -- host/auth.sh@45 -- # key=DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:40.922 15:33:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:40.922 15:33:44 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:40.922 15:33:44 -- host/auth.sh@49 -- # echo DHHC-1:00:ZDYxNjJjZGM0NWY3NDU1NjI3N2NiYzZkNmVjYjc0YjYcXDIP: 00:32:40.922 15:33:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:32:40.922 15:33:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:40.922 15:33:44 -- host/auth.sh@68 -- # digest=sha512 00:32:40.922 15:33:44 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:40.922 15:33:44 -- host/auth.sh@68 -- # keyid=0 00:32:40.922 15:33:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:40.922 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.922 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:40.922 15:33:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.922 15:33:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:40.922 15:33:44 -- nvmf/common.sh@717 -- # local ip 00:32:40.922 15:33:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:40.922 15:33:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:40.922 15:33:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:40.922 15:33:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:40.922 15:33:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:40.922 15:33:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:40.922 15:33:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:40.922 15:33:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:40.922 15:33:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:40.922 15:33:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:40.922 15:33:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.922 15:33:44 -- common/autotest_common.sh@10 -- # set +x 00:32:41.491 nvme0n1 00:32:41.491 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.491 15:33:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:41.491 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.491 15:33:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:41.491 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:41.491 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.491 15:33:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:41.491 15:33:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:41.491 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.491 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:41.491 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.491 15:33:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:41.491 15:33:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:32:41.491 15:33:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:41.491 15:33:45 -- host/auth.sh@44 -- # digest=sha512 00:32:41.491 15:33:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:41.491 15:33:45 -- host/auth.sh@44 -- # keyid=1 00:32:41.491 15:33:45 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:41.491 15:33:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:41.491 15:33:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:41.491 15:33:45 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:41.491 15:33:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:32:41.491 15:33:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:41.491 15:33:45 -- host/auth.sh@68 -- # digest=sha512 00:32:41.492 15:33:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:41.492 15:33:45 -- host/auth.sh@68 -- # keyid=1 00:32:41.492 15:33:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:41.492 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.492 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:41.492 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.492 15:33:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:41.492 15:33:45 -- nvmf/common.sh@717 -- # local ip 00:32:41.492 15:33:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:41.492 15:33:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:41.492 15:33:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:41.492 15:33:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:41.492 15:33:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:41.492 15:33:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:41.492 15:33:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:41.492 15:33:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:41.492 15:33:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:41.492 15:33:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:41.492 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.492 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:42.061 nvme0n1 00:32:42.061 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.061 15:33:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:42.061 15:33:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:42.061 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.061 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:42.061 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.061 15:33:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:42.061 15:33:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:42.061 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.061 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:42.061 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.061 15:33:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:42.061 15:33:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:32:42.061 15:33:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:42.061 15:33:45 -- host/auth.sh@44 -- # digest=sha512 00:32:42.061 15:33:45 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:42.061 15:33:45 -- host/auth.sh@44 -- # keyid=2 00:32:42.061 15:33:45 -- host/auth.sh@45 -- # key=DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:42.061 15:33:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:42.061 15:33:45 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:42.061 15:33:45 -- host/auth.sh@49 -- # echo DHHC-1:01:YWIwMDNiZWU2NThmMTYxOTU1NzBhNjUyYWJkMzY5NTgbz19a: 00:32:42.061 15:33:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:32:42.061 15:33:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:42.061 15:33:45 -- host/auth.sh@68 -- # digest=sha512 00:32:42.061 15:33:45 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:42.061 15:33:45 -- host/auth.sh@68 -- # keyid=2 00:32:42.061 15:33:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:42.061 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.061 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:42.061 15:33:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.061 15:33:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:42.061 15:33:45 -- nvmf/common.sh@717 -- # local ip 00:32:42.061 15:33:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:42.061 15:33:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:42.061 15:33:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:42.061 15:33:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:42.061 15:33:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:42.061 15:33:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:42.061 15:33:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:42.061 15:33:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:42.061 15:33:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:42.061 15:33:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:42.061 15:33:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.061 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:32:42.629 nvme0n1 00:32:42.629 15:33:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.629 15:33:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:42.629 15:33:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:42.629 15:33:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.629 15:33:46 -- common/autotest_common.sh@10 -- # set +x 00:32:42.629 15:33:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.629 15:33:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:42.888 15:33:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:42.888 15:33:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.888 15:33:46 -- common/autotest_common.sh@10 -- # set +x 00:32:42.888 15:33:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.888 15:33:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:42.888 15:33:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:32:42.888 15:33:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:42.888 15:33:46 -- host/auth.sh@44 -- # digest=sha512 00:32:42.888 15:33:46 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:42.888 15:33:46 -- host/auth.sh@44 -- # keyid=3 00:32:42.889 15:33:46 -- host/auth.sh@45 -- # key=DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:42.889 15:33:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:42.889 15:33:46 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:42.889 15:33:46 -- host/auth.sh@49 -- # echo DHHC-1:02:MWU2ZTYwODg3ZWUyNzI0MTNhOGI0MzFiZjBlYWU2OTE3MjliZGJmNTFhOTQ1YjhlSOaznA==: 00:32:42.889 15:33:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:32:42.889 15:33:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:42.889 15:33:46 -- host/auth.sh@68 -- # digest=sha512 00:32:42.889 15:33:46 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:42.889 15:33:46 -- host/auth.sh@68 -- # keyid=3 00:32:42.889 15:33:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:42.889 15:33:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.889 15:33:46 -- common/autotest_common.sh@10 -- # set +x 00:32:42.889 15:33:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.889 15:33:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:42.889 15:33:46 -- nvmf/common.sh@717 -- # local ip 00:32:42.889 15:33:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:42.889 15:33:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:42.889 15:33:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:42.889 15:33:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:42.889 15:33:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:42.889 15:33:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:42.889 15:33:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:42.889 15:33:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:42.889 15:33:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:42.889 15:33:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:42.889 15:33:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.889 15:33:46 -- common/autotest_common.sh@10 -- # set +x 00:32:43.458 nvme0n1 00:32:43.458 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.458 15:33:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:43.458 15:33:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:43.458 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.458 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:43.458 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.458 15:33:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:43.458 15:33:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:43.458 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.458 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:43.458 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.458 15:33:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:43.458 15:33:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:32:43.458 15:33:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:43.458 15:33:47 -- host/auth.sh@44 -- # digest=sha512 00:32:43.458 15:33:47 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:43.458 15:33:47 -- host/auth.sh@44 -- # keyid=4 00:32:43.458 15:33:47 -- host/auth.sh@45 -- # key=DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:43.458 15:33:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:43.458 15:33:47 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:43.458 15:33:47 -- host/auth.sh@49 -- # echo DHHC-1:03:MzhlNTZiYThmZGUxMWQwNDgxZDI5OWQzOWE0N2ViNThjMzRiYmJlYjJmNGE2ZjcwYjcwNjczM2M5NmFmMzIzMdo8J7c=: 00:32:43.458 15:33:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:32:43.458 15:33:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:43.458 15:33:47 -- host/auth.sh@68 -- # digest=sha512 00:32:43.458 15:33:47 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:43.458 15:33:47 -- host/auth.sh@68 -- # keyid=4 00:32:43.458 15:33:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:43.458 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.458 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:43.458 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.458 15:33:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:43.458 15:33:47 -- nvmf/common.sh@717 -- # local ip 00:32:43.458 15:33:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:43.458 15:33:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:43.458 15:33:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:43.458 15:33:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:43.458 15:33:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:43.458 15:33:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:43.458 15:33:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:43.458 15:33:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:43.458 15:33:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:43.458 15:33:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:43.458 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.458 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.027 nvme0n1 00:32:44.027 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.027 15:33:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:44.027 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.027 15:33:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:44.027 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.027 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.027 15:33:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:44.027 15:33:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:44.027 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.027 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.027 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.027 15:33:47 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:44.027 15:33:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:44.027 15:33:47 -- host/auth.sh@44 -- # digest=sha256 00:32:44.027 15:33:47 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:44.027 15:33:47 -- host/auth.sh@44 -- # keyid=1 00:32:44.027 15:33:47 -- host/auth.sh@45 -- # key=DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:44.027 15:33:47 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:44.027 15:33:47 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:44.027 15:33:47 -- host/auth.sh@49 -- # echo DHHC-1:00:OWQ2YTk4MzBjYjljZDIxNjE4ZDhhNDhiNjI0OTQyZDQyM2UyMzZiZTQyNGU3NzBm4lPwww==: 00:32:44.028 15:33:47 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:44.028 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.028 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.028 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.028 15:33:47 -- host/auth.sh@119 -- # get_main_ns_ip 00:32:44.028 15:33:47 -- nvmf/common.sh@717 -- # local ip 00:32:44.028 15:33:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:44.028 15:33:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:44.028 15:33:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:44.028 15:33:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:44.028 15:33:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:44.028 15:33:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:44.028 15:33:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:44.028 15:33:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:44.028 15:33:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:44.028 15:33:47 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:44.028 15:33:47 -- common/autotest_common.sh@638 -- # local es=0 00:32:44.028 15:33:47 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:44.028 15:33:47 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:44.028 15:33:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:44.028 15:33:47 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:44.028 15:33:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:44.028 15:33:47 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:44.028 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.028 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.028 request: 00:32:44.028 { 00:32:44.028 "name": "nvme0", 00:32:44.028 "trtype": "rdma", 00:32:44.028 "traddr": "192.168.100.8", 00:32:44.028 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:44.028 "adrfam": "ipv4", 00:32:44.028 "trsvcid": "4420", 00:32:44.028 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:44.028 "method": "bdev_nvme_attach_controller", 00:32:44.028 "req_id": 1 00:32:44.028 } 00:32:44.028 Got JSON-RPC error response 00:32:44.028 response: 00:32:44.028 { 00:32:44.028 "code": -32602, 00:32:44.028 "message": "Invalid parameters" 00:32:44.028 } 00:32:44.028 15:33:47 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:44.028 15:33:47 -- common/autotest_common.sh@641 -- # es=1 00:32:44.028 15:33:47 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:44.028 15:33:47 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:44.028 15:33:47 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:44.028 15:33:47 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:32:44.028 15:33:47 -- host/auth.sh@121 -- # jq length 00:32:44.028 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.028 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.288 15:33:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.288 15:33:47 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:32:44.288 15:33:47 -- host/auth.sh@124 -- # get_main_ns_ip 00:32:44.288 15:33:47 -- nvmf/common.sh@717 -- # local ip 00:32:44.288 15:33:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:44.288 15:33:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:44.288 15:33:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:44.288 15:33:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:44.288 15:33:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:44.288 15:33:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:44.288 15:33:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:44.288 15:33:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:44.288 15:33:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:44.288 15:33:47 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:44.288 15:33:47 -- common/autotest_common.sh@638 -- # local es=0 00:32:44.288 15:33:47 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:44.288 15:33:47 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:44.288 15:33:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:44.288 15:33:47 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:44.288 15:33:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:44.288 15:33:47 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:44.288 15:33:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.288 15:33:47 -- common/autotest_common.sh@10 -- # set +x 00:32:44.288 request: 00:32:44.288 { 00:32:44.288 "name": "nvme0", 00:32:44.288 "trtype": "rdma", 00:32:44.288 "traddr": "192.168.100.8", 00:32:44.288 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:44.288 "adrfam": "ipv4", 00:32:44.288 "trsvcid": "4420", 00:32:44.288 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:44.288 "dhchap_key": "key2", 00:32:44.288 "method": "bdev_nvme_attach_controller", 00:32:44.288 "req_id": 1 00:32:44.288 } 00:32:44.288 Got JSON-RPC error response 00:32:44.288 response: 00:32:44.288 { 00:32:44.288 "code": -32602, 00:32:44.288 "message": "Invalid parameters" 00:32:44.288 } 00:32:44.288 15:33:48 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:44.288 15:33:48 -- common/autotest_common.sh@641 -- # es=1 00:32:44.288 15:33:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:44.288 15:33:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:44.288 15:33:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:44.288 15:33:48 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:32:44.288 15:33:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:44.288 15:33:48 -- host/auth.sh@127 -- # jq length 00:32:44.288 15:33:48 -- common/autotest_common.sh@10 -- # set +x 00:32:44.288 15:33:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:44.288 15:33:48 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:32:44.288 15:33:48 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:32:44.288 15:33:48 -- host/auth.sh@130 -- # cleanup 00:32:44.288 15:33:48 -- host/auth.sh@24 -- # nvmftestfini 00:32:44.288 15:33:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:44.288 15:33:48 -- nvmf/common.sh@117 -- # sync 00:32:44.288 15:33:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:32:44.288 15:33:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:32:44.288 15:33:48 -- nvmf/common.sh@120 -- # set +e 00:32:44.288 15:33:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:44.288 15:33:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:32:44.288 rmmod nvme_rdma 00:32:44.288 rmmod nvme_fabrics 00:32:44.288 15:33:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:44.288 15:33:48 -- nvmf/common.sh@124 -- # set -e 00:32:44.288 15:33:48 -- nvmf/common.sh@125 -- # return 0 00:32:44.288 15:33:48 -- nvmf/common.sh@478 -- # '[' -n 803586 ']' 00:32:44.288 15:33:48 -- nvmf/common.sh@479 -- # killprocess 803586 00:32:44.288 15:33:48 -- common/autotest_common.sh@936 -- # '[' -z 803586 ']' 00:32:44.288 15:33:48 -- common/autotest_common.sh@940 -- # kill -0 803586 00:32:44.288 15:33:48 -- common/autotest_common.sh@941 -- # uname 00:32:44.288 15:33:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:44.548 15:33:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 803586 00:32:44.548 15:33:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:44.548 15:33:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:44.548 15:33:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 803586' 00:32:44.548 killing process with pid 803586 00:32:44.548 15:33:48 -- common/autotest_common.sh@955 -- # kill 803586 00:32:44.548 15:33:48 -- common/autotest_common.sh@960 -- # wait 803586 00:32:44.548 15:33:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:32:44.548 15:33:48 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:32:44.548 15:33:48 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:32:44.548 15:33:48 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:32:44.548 15:33:48 -- host/auth.sh@27 -- # clean_kernel_target 00:32:44.548 15:33:48 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:32:44.548 15:33:48 -- nvmf/common.sh@675 -- # echo 0 00:32:44.548 15:33:48 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:44.548 15:33:48 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:44.548 15:33:48 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:44.807 15:33:48 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:44.807 15:33:48 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:32:44.807 15:33:48 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:32:44.807 15:33:48 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:32:48.098 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:48.098 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:50.689 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:32:50.947 15:33:54 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.rVN /tmp/spdk.key-null.8Hy /tmp/spdk.key-sha256.k0d /tmp/spdk.key-sha384.tuE /tmp/spdk.key-sha512.sMU /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/nvme-auth.log 00:32:50.947 15:33:54 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh 00:32:54.235 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:32:54.235 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:32:54.235 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:32:54.235 00:32:54.235 real 0m58.665s 00:32:54.235 user 0m50.778s 00:32:54.235 sys 0m16.001s 00:32:54.235 15:33:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:54.235 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:32:54.235 ************************************ 00:32:54.235 END TEST nvmf_auth 00:32:54.235 ************************************ 00:32:54.235 15:33:58 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:32:54.235 15:33:58 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:32:54.235 15:33:58 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:32:54.235 15:33:58 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:32:54.235 15:33:58 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:54.235 15:33:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:54.235 15:33:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:54.235 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:32:54.494 ************************************ 00:32:54.494 START TEST nvmf_bdevperf 00:32:54.494 ************************************ 00:32:54.494 15:33:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:54.494 * Looking for test storage... 00:32:54.494 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:32:54.494 15:33:58 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:32:54.494 15:33:58 -- nvmf/common.sh@7 -- # uname -s 00:32:54.494 15:33:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:54.494 15:33:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:54.494 15:33:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:54.494 15:33:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:54.494 15:33:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:54.494 15:33:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:54.494 15:33:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:54.494 15:33:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:54.494 15:33:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:54.494 15:33:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:54.494 15:33:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:32:54.495 15:33:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:32:54.495 15:33:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:54.495 15:33:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:54.495 15:33:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:54.495 15:33:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:54.495 15:33:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:32:54.495 15:33:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:54.495 15:33:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:54.495 15:33:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:54.495 15:33:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.495 15:33:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.495 15:33:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.495 15:33:58 -- paths/export.sh@5 -- # export PATH 00:32:54.495 15:33:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:54.495 15:33:58 -- nvmf/common.sh@47 -- # : 0 00:32:54.495 15:33:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:54.495 15:33:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:54.495 15:33:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:54.495 15:33:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:54.495 15:33:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:54.495 15:33:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:54.495 15:33:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:54.495 15:33:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:54.495 15:33:58 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:32:54.495 15:33:58 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:32:54.495 15:33:58 -- host/bdevperf.sh@24 -- # nvmftestinit 00:32:54.495 15:33:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:32:54.495 15:33:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:54.495 15:33:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:32:54.495 15:33:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:32:54.495 15:33:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:32:54.495 15:33:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:54.495 15:33:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:54.495 15:33:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:54.495 15:33:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:32:54.495 15:33:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:32:54.495 15:33:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:32:54.495 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:33:02.617 15:34:05 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:02.617 15:34:05 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:02.617 15:34:05 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:02.617 15:34:05 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:02.617 15:34:05 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:02.617 15:34:05 -- nvmf/common.sh@295 -- # net_devs=() 00:33:02.617 15:34:05 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@296 -- # e810=() 00:33:02.617 15:34:05 -- nvmf/common.sh@296 -- # local -ga e810 00:33:02.617 15:34:05 -- nvmf/common.sh@297 -- # x722=() 00:33:02.617 15:34:05 -- nvmf/common.sh@297 -- # local -ga x722 00:33:02.617 15:34:05 -- nvmf/common.sh@298 -- # mlx=() 00:33:02.617 15:34:05 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:02.617 15:34:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:02.617 15:34:05 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:33:02.617 Found 0000:18:00.0 (0x8086 - 0x1592) 00:33:02.617 15:34:05 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:02.617 15:34:05 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:33:02.617 Found 0000:18:00.1 (0x8086 - 0x1592) 00:33:02.617 15:34:05 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:02.617 15:34:05 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@377 -- # modinfo irdma 00:33:02.617 15:34:05 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:33:02.617 15:34:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:02.617 15:34:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:02.617 15:34:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:33:02.617 Found net devices under 0000:18:00.0: cvl_0_0 00:33:02.617 15:34:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:02.617 15:34:05 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:02.617 15:34:05 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:33:02.617 Found net devices under 0000:18:00.1: cvl_0_1 00:33:02.617 15:34:05 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:02.617 15:34:05 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:02.617 15:34:05 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:02.617 15:34:05 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:02.617 15:34:05 -- nvmf/common.sh@58 -- # uname 00:33:02.617 15:34:05 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:02.617 15:34:05 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:02.617 15:34:05 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:02.617 15:34:05 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:02.617 15:34:05 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:02.617 15:34:05 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:02.617 15:34:05 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:02.617 15:34:05 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:02.617 15:34:05 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:02.617 15:34:05 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:02.617 15:34:05 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:02.617 15:34:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:02.617 15:34:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:02.617 15:34:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:02.617 15:34:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:33:02.617 15:34:05 -- nvmf/common.sh@105 -- # continue 2 00:33:02.617 15:34:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.617 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:33:02.617 15:34:05 -- nvmf/common.sh@105 -- # continue 2 00:33:02.617 15:34:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:02.617 15:34:05 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:33:02.617 15:34:05 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:02.617 15:34:05 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:02.617 15:34:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:33:02.617 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:33:02.617 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:33:02.617 altname enp24s0f0np0 00:33:02.617 altname ens785f0np0 00:33:02.617 inet 192.168.100.8/24 scope global cvl_0_0 00:33:02.617 valid_lft forever preferred_lft forever 00:33:02.617 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:33:02.617 valid_lft forever preferred_lft forever 00:33:02.617 15:34:05 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:02.617 15:34:05 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:33:02.617 15:34:05 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:02.617 15:34:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:33:02.617 15:34:05 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:02.617 15:34:05 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:33:02.617 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:33:02.617 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:33:02.617 altname enp24s0f1np1 00:33:02.617 altname ens785f1np1 00:33:02.617 inet 192.168.100.9/24 scope global cvl_0_1 00:33:02.617 valid_lft forever preferred_lft forever 00:33:02.617 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:33:02.617 valid_lft forever preferred_lft forever 00:33:02.617 15:34:05 -- nvmf/common.sh@411 -- # return 0 00:33:02.617 15:34:05 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:02.617 15:34:05 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:02.617 15:34:05 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:02.617 15:34:05 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:02.617 15:34:05 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:02.617 15:34:05 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:02.617 15:34:05 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:02.617 15:34:05 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:02.618 15:34:05 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:02.618 15:34:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:02.618 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.618 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:33:02.618 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.618 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:33:02.618 15:34:05 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:33:02.618 15:34:05 -- nvmf/common.sh@105 -- # continue 2 00:33:02.618 15:34:05 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:02.618 15:34:05 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:02.618 15:34:05 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:33:02.618 15:34:05 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:33:02.618 15:34:05 -- nvmf/common.sh@105 -- # continue 2 00:33:02.618 15:34:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:02.618 15:34:05 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:33:02.618 15:34:05 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:02.618 15:34:05 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:02.618 15:34:05 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:33:02.618 15:34:05 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:02.618 15:34:05 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:02.618 15:34:05 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:02.618 192.168.100.9' 00:33:02.618 15:34:05 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:02.618 192.168.100.9' 00:33:02.618 15:34:05 -- nvmf/common.sh@446 -- # head -n 1 00:33:02.618 15:34:05 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:02.618 15:34:05 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:02.618 192.168.100.9' 00:33:02.618 15:34:05 -- nvmf/common.sh@447 -- # tail -n +2 00:33:02.618 15:34:05 -- nvmf/common.sh@447 -- # head -n 1 00:33:02.618 15:34:05 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:02.618 15:34:05 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:02.618 15:34:05 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:02.618 15:34:05 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:02.618 15:34:05 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:02.618 15:34:05 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:02.618 15:34:05 -- host/bdevperf.sh@25 -- # tgt_init 00:33:02.618 15:34:05 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:33:02.618 15:34:05 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:02.618 15:34:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:02.618 15:34:05 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 15:34:05 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:33:02.618 15:34:05 -- nvmf/common.sh@470 -- # nvmfpid=816167 00:33:02.618 15:34:05 -- nvmf/common.sh@471 -- # waitforlisten 816167 00:33:02.618 15:34:05 -- common/autotest_common.sh@817 -- # '[' -z 816167 ']' 00:33:02.618 15:34:05 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:02.618 15:34:05 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:02.618 15:34:05 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:02.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:02.618 15:34:05 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:02.618 15:34:05 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 [2024-04-24 15:34:05.336983] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:02.618 [2024-04-24 15:34:05.337037] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:02.618 EAL: No free 2048 kB hugepages reported on node 1 00:33:02.618 [2024-04-24 15:34:05.415517] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:33:02.618 [2024-04-24 15:34:05.497904] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:02.618 [2024-04-24 15:34:05.497943] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:02.618 [2024-04-24 15:34:05.497953] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:02.618 [2024-04-24 15:34:05.497961] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:02.618 [2024-04-24 15:34:05.497967] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:02.618 [2024-04-24 15:34:05.498084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:02.618 [2024-04-24 15:34:05.498188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:02.618 [2024-04-24 15:34:05.498181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:02.618 15:34:06 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:02.618 15:34:06 -- common/autotest_common.sh@850 -- # return 0 00:33:02.618 15:34:06 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:02.618 15:34:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 15:34:06 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:02.618 15:34:06 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:33:02.618 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 [2024-04-24 15:34:06.229592] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x12b10e0/0x12b0720) succeed. 00:33:02.618 [2024-04-24 15:34:06.239939] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x12b2410/0x12b0ca0) succeed. 00:33:02.618 [2024-04-24 15:34:06.239963] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:33:02.618 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:02.618 15:34:06 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:02.618 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 Malloc0 00:33:02.618 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:02.618 15:34:06 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:02.618 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:02.618 15:34:06 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:02.618 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:02.618 15:34:06 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:02.618 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:02.618 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:33:02.618 [2024-04-24 15:34:06.309494] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:02.618 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:02.618 15:34:06 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:33:02.618 15:34:06 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:33:02.618 15:34:06 -- nvmf/common.sh@521 -- # config=() 00:33:02.618 15:34:06 -- nvmf/common.sh@521 -- # local subsystem config 00:33:02.618 15:34:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:33:02.618 15:34:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:33:02.618 { 00:33:02.618 "params": { 00:33:02.618 "name": "Nvme$subsystem", 00:33:02.618 "trtype": "$TEST_TRANSPORT", 00:33:02.618 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:02.618 "adrfam": "ipv4", 00:33:02.618 "trsvcid": "$NVMF_PORT", 00:33:02.618 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:02.618 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:02.618 "hdgst": ${hdgst:-false}, 00:33:02.618 "ddgst": ${ddgst:-false} 00:33:02.618 }, 00:33:02.618 "method": "bdev_nvme_attach_controller" 00:33:02.618 } 00:33:02.618 EOF 00:33:02.618 )") 00:33:02.618 15:34:06 -- nvmf/common.sh@543 -- # cat 00:33:02.618 15:34:06 -- nvmf/common.sh@545 -- # jq . 00:33:02.618 15:34:06 -- nvmf/common.sh@546 -- # IFS=, 00:33:02.618 15:34:06 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:33:02.618 "params": { 00:33:02.618 "name": "Nvme1", 00:33:02.618 "trtype": "rdma", 00:33:02.618 "traddr": "192.168.100.8", 00:33:02.618 "adrfam": "ipv4", 00:33:02.618 "trsvcid": "4420", 00:33:02.618 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:02.618 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:02.618 "hdgst": false, 00:33:02.618 "ddgst": false 00:33:02.618 }, 00:33:02.618 "method": "bdev_nvme_attach_controller" 00:33:02.618 }' 00:33:02.618 [2024-04-24 15:34:06.362049] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:02.618 [2024-04-24 15:34:06.362106] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid816358 ] 00:33:02.618 EAL: No free 2048 kB hugepages reported on node 1 00:33:02.618 [2024-04-24 15:34:06.444736] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:33:02.618 [2024-04-24 15:34:06.522987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:02.878 Running I/O for 1 seconds... 00:33:03.816 00:33:03.816 Latency(us) 00:33:03.816 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:33:03.816 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:33:03.816 Verification LBA range: start 0x0 length 0x4000 00:33:03.816 Nvme1n1 : 1.01 18407.48 71.90 0.00 0.00 6912.60 2478.97 12594.31 00:33:03.816 =================================================================================================================== 00:33:03.816 Total : 18407.48 71.90 0.00 0.00 6912.60 2478.97 12594.31 00:33:04.075 15:34:07 -- host/bdevperf.sh@30 -- # bdevperfpid=816546 00:33:04.075 15:34:07 -- host/bdevperf.sh@32 -- # sleep 3 00:33:04.075 15:34:07 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:33:04.075 15:34:07 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:33:04.075 15:34:07 -- nvmf/common.sh@521 -- # config=() 00:33:04.075 15:34:07 -- nvmf/common.sh@521 -- # local subsystem config 00:33:04.075 15:34:07 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:33:04.075 15:34:07 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:33:04.075 { 00:33:04.075 "params": { 00:33:04.075 "name": "Nvme$subsystem", 00:33:04.075 "trtype": "$TEST_TRANSPORT", 00:33:04.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:04.075 "adrfam": "ipv4", 00:33:04.075 "trsvcid": "$NVMF_PORT", 00:33:04.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:04.075 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:04.075 "hdgst": ${hdgst:-false}, 00:33:04.075 "ddgst": ${ddgst:-false} 00:33:04.075 }, 00:33:04.075 "method": "bdev_nvme_attach_controller" 00:33:04.075 } 00:33:04.075 EOF 00:33:04.075 )") 00:33:04.075 15:34:07 -- nvmf/common.sh@543 -- # cat 00:33:04.075 15:34:07 -- nvmf/common.sh@545 -- # jq . 00:33:04.075 15:34:07 -- nvmf/common.sh@546 -- # IFS=, 00:33:04.075 15:34:07 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:33:04.075 "params": { 00:33:04.075 "name": "Nvme1", 00:33:04.075 "trtype": "rdma", 00:33:04.075 "traddr": "192.168.100.8", 00:33:04.075 "adrfam": "ipv4", 00:33:04.075 "trsvcid": "4420", 00:33:04.075 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:04.075 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:04.075 "hdgst": false, 00:33:04.075 "ddgst": false 00:33:04.075 }, 00:33:04.075 "method": "bdev_nvme_attach_controller" 00:33:04.075 }' 00:33:04.334 [2024-04-24 15:34:07.989986] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:04.335 [2024-04-24 15:34:07.990049] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid816546 ] 00:33:04.335 EAL: No free 2048 kB hugepages reported on node 1 00:33:04.335 [2024-04-24 15:34:08.071582] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:33:04.335 [2024-04-24 15:34:08.149649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:04.594 Running I/O for 15 seconds... 00:33:07.132 15:34:10 -- host/bdevperf.sh@33 -- # kill -9 816167 00:33:07.132 15:34:10 -- host/bdevperf.sh@35 -- # sleep 3 00:33:07.703 [2024-04-24 15:34:11.508518] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:07.703 [2024-04-24 15:34:11.508562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:126744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:126752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:126760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:126768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:126776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:126784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:126792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:126800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:126808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:126816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:126824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:126832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:126840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:126848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:126856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:126864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:126872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:126880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:126888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:126896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.508988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:126904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0xdf227d22 00:33:07.703 [2024-04-24 15:34:11.508997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.703 [2024-04-24 15:34:11.509008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:126912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:126920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:126928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:126936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:126944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:126952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:126960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:126968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0xdf227d22 00:33:07.704 [2024-04-24 15:34:11.509150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:126976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:126984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:126992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:127000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:127008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:127016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:127024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:127032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:127040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:127048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:127056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:127064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:127072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:127080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:127088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:127096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:127104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:127112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:127120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:127128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:127136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:127144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:127152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:127160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:127168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:127176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:127184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:127192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:127200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.704 [2024-04-24 15:34:11.509710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:127208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.704 [2024-04-24 15:34:11.509718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:127216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:127224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:127232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:127240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:127248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:127256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:127264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:127272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:127280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:127288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:127296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:127304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:127312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:127320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.509984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.509994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:127328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:127336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:127344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:127352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:127360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:127368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:127376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:127384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:127392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:127400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:127408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:127416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:127424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:127432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:127440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:127448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:127456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:127464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:127472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:127480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:127488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:127496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:127504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:127512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.705 [2024-04-24 15:34:11.510435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.705 [2024-04-24 15:34:11.510445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:127520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:127528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:127536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:127544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:127552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:127560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:127568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:127576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:127584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:127592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:127600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:127608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:127616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:127624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:127632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:127640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:127648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:127656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:127664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:127672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:127680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:127688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:127696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:127704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:127712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:127720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:127728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:127736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:127744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.510986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.510996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:127752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:07.706 [2024-04-24 15:34:11.511004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:63a6f0 sqhd:4a00 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.511330] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:33:07.706 [2024-04-24 15:34:11.511343] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:33:07.706 [2024-04-24 15:34:11.511351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:127760 len:8 PRP1 0x0 PRP2 0x0 00:33:07.706 [2024-04-24 15:34:11.511361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:33:07.706 [2024-04-24 15:34:11.511405] bdev_nvme.c:1600:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:33:07.706 [2024-04-24 15:34:11.514003] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:07.706 [2024-04-24 15:34:11.514044] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:07.706 [2024-04-24 15:34:11.527023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:07.706 [2024-04-24 15:34:11.529858] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:07.706 [2024-04-24 15:34:11.529879] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:07.706 [2024-04-24 15:34:11.529888] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:08.643 [2024-04-24 15:34:12.532634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:08.643 [2024-04-24 15:34:12.532658] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:08.643 [2024-04-24 15:34:12.532832] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:08.643 [2024-04-24 15:34:12.532844] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:08.643 [2024-04-24 15:34:12.532855] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:08.643 [2024-04-24 15:34:12.534440] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:33:08.643 [2024-04-24 15:34:12.535499] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:08.643 [2024-04-24 15:34:12.547220] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:08.643 [2024-04-24 15:34:12.550219] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:08.643 [2024-04-24 15:34:12.550240] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:08.643 [2024-04-24 15:34:12.550249] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:10.030 [2024-04-24 15:34:13.553072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:10.030 [2024-04-24 15:34:13.553097] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:10.030 [2024-04-24 15:34:13.553267] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:10.030 [2024-04-24 15:34:13.553278] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:10.030 [2024-04-24 15:34:13.553288] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:10.030 [2024-04-24 15:34:13.555344] bdev_nvme.c:2877:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:33:10.030 [2024-04-24 15:34:13.555995] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:10.030 [2024-04-24 15:34:13.568151] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:10.031 [2024-04-24 15:34:13.570993] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:10.031 [2024-04-24 15:34:13.571014] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:10.031 [2024-04-24 15:34:13.571023] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:10.291 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 816167 Killed "${NVMF_APP[@]}" "$@" 00:33:10.291 15:34:13 -- host/bdevperf.sh@36 -- # tgt_init 00:33:10.291 15:34:13 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:33:10.291 15:34:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:10.291 15:34:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:10.291 15:34:13 -- common/autotest_common.sh@10 -- # set +x 00:33:10.291 15:34:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:33:10.291 15:34:13 -- nvmf/common.sh@470 -- # nvmfpid=817261 00:33:10.291 15:34:13 -- nvmf/common.sh@471 -- # waitforlisten 817261 00:33:10.291 15:34:13 -- common/autotest_common.sh@817 -- # '[' -z 817261 ']' 00:33:10.291 15:34:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:10.291 15:34:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:10.291 15:34:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:10.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:10.291 15:34:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:10.291 15:34:13 -- common/autotest_common.sh@10 -- # set +x 00:33:10.291 [2024-04-24 15:34:14.000424] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:10.291 [2024-04-24 15:34:14.000483] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:10.291 EAL: No free 2048 kB hugepages reported on node 1 00:33:10.291 [2024-04-24 15:34:14.083390] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:33:10.291 [2024-04-24 15:34:14.168215] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:10.291 [2024-04-24 15:34:14.168266] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:10.291 [2024-04-24 15:34:14.168276] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:10.291 [2024-04-24 15:34:14.168285] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:10.291 [2024-04-24 15:34:14.168292] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:10.291 [2024-04-24 15:34:14.168347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:10.291 [2024-04-24 15:34:14.168419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:10.291 [2024-04-24 15:34:14.168421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:10.859 [2024-04-24 15:34:14.573828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:10.859 [2024-04-24 15:34:14.573873] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:10.859 [2024-04-24 15:34:14.574052] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:10.860 [2024-04-24 15:34:14.574064] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:10.860 [2024-04-24 15:34:14.574074] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:10.860 [2024-04-24 15:34:14.576819] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:10.860 [2024-04-24 15:34:14.581188] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:10.860 [2024-04-24 15:34:14.584094] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:10.860 [2024-04-24 15:34:14.584116] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:10.860 [2024-04-24 15:34:14.584125] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:11.119 15:34:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:11.119 15:34:14 -- common/autotest_common.sh@850 -- # return 0 00:33:11.119 15:34:14 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:11.119 15:34:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 15:34:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:11.119 15:34:14 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:33:11.119 15:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 [2024-04-24 15:34:14.889714] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x102e0e0/0x102d720) succeed. 00:33:11.119 [2024-04-24 15:34:14.900123] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x102f410/0x102dca0) succeed. 00:33:11.119 [2024-04-24 15:34:14.900145] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:33:11.119 15:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:11.119 15:34:14 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:11.119 15:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 Malloc0 00:33:11.119 15:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:11.119 15:34:14 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:11.119 15:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 15:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:11.119 15:34:14 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:11.119 15:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 15:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:11.119 15:34:14 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:11.119 15:34:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:11.119 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:33:11.119 [2024-04-24 15:34:14.971076] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:11.119 15:34:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:11.119 15:34:14 -- host/bdevperf.sh@38 -- # wait 816546 00:33:11.687 [2024-04-24 15:34:15.586897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:11.687 [2024-04-24 15:34:15.586925] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:11.687 [2024-04-24 15:34:15.587102] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:11.687 [2024-04-24 15:34:15.587114] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:11.687 [2024-04-24 15:34:15.587125] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:11.687 [2024-04-24 15:34:15.589872] bdev_nvme.c:2051:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:11.687 [2024-04-24 15:34:15.597143] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:11.947 [2024-04-24 15:34:15.647426] bdev_nvme.c:2053:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:33:20.070 00:33:20.070 Latency(us) 00:33:20.070 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:33:20.070 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:33:20.070 Verification LBA range: start 0x0 length 0x4000 00:33:20.070 Nvme1n1 : 15.00 12757.47 49.83 13963.46 0.00 4770.41 434.53 565319.23 00:33:20.070 =================================================================================================================== 00:33:20.070 Total : 12757.47 49.83 13963.46 0.00 4770.41 434.53 565319.23 00:33:20.070 15:34:23 -- host/bdevperf.sh@39 -- # sync 00:33:20.070 15:34:23 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:20.070 15:34:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:20.070 15:34:23 -- common/autotest_common.sh@10 -- # set +x 00:33:20.070 15:34:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:20.070 15:34:23 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:33:20.070 15:34:23 -- host/bdevperf.sh@44 -- # nvmftestfini 00:33:20.070 15:34:23 -- nvmf/common.sh@477 -- # nvmfcleanup 00:33:20.070 15:34:23 -- nvmf/common.sh@117 -- # sync 00:33:20.070 15:34:23 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:33:20.070 15:34:23 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:33:20.070 15:34:23 -- nvmf/common.sh@120 -- # set +e 00:33:20.070 15:34:23 -- nvmf/common.sh@121 -- # for i in {1..20} 00:33:20.070 15:34:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:33:20.070 rmmod nvme_rdma 00:33:20.070 rmmod nvme_fabrics 00:33:20.070 15:34:23 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:33:20.070 15:34:23 -- nvmf/common.sh@124 -- # set -e 00:33:20.070 15:34:23 -- nvmf/common.sh@125 -- # return 0 00:33:20.070 15:34:23 -- nvmf/common.sh@478 -- # '[' -n 817261 ']' 00:33:20.070 15:34:23 -- nvmf/common.sh@479 -- # killprocess 817261 00:33:20.070 15:34:23 -- common/autotest_common.sh@936 -- # '[' -z 817261 ']' 00:33:20.070 15:34:23 -- common/autotest_common.sh@940 -- # kill -0 817261 00:33:20.070 15:34:23 -- common/autotest_common.sh@941 -- # uname 00:33:20.070 15:34:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:20.070 15:34:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 817261 00:33:20.070 15:34:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:33:20.070 15:34:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:33:20.070 15:34:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 817261' 00:33:20.070 killing process with pid 817261 00:33:20.070 15:34:23 -- common/autotest_common.sh@955 -- # kill 817261 00:33:20.070 15:34:23 -- common/autotest_common.sh@960 -- # wait 817261 00:33:20.070 [2024-04-24 15:34:23.739417] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:33:20.070 15:34:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:33:20.070 15:34:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:33:20.070 00:33:20.070 real 0m25.702s 00:33:20.070 user 1m4.732s 00:33:20.070 sys 0m6.424s 00:33:20.070 15:34:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:20.070 15:34:23 -- common/autotest_common.sh@10 -- # set +x 00:33:20.070 ************************************ 00:33:20.070 END TEST nvmf_bdevperf 00:33:20.070 ************************************ 00:33:20.330 15:34:23 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:33:20.330 15:34:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:33:20.330 15:34:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:20.330 15:34:23 -- common/autotest_common.sh@10 -- # set +x 00:33:20.330 ************************************ 00:33:20.330 START TEST nvmf_target_disconnect 00:33:20.330 ************************************ 00:33:20.330 15:34:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:33:20.330 * Looking for test storage... 00:33:20.330 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host 00:33:20.330 15:34:24 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:33:20.330 15:34:24 -- nvmf/common.sh@7 -- # uname -s 00:33:20.330 15:34:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:20.330 15:34:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:20.330 15:34:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:20.330 15:34:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:20.330 15:34:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:20.330 15:34:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:20.330 15:34:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:20.330 15:34:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:20.330 15:34:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:20.330 15:34:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:20.591 15:34:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:33:20.591 15:34:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:33:20.591 15:34:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:20.591 15:34:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:20.591 15:34:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:20.591 15:34:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:33:20.591 15:34:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:33:20.591 15:34:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:20.591 15:34:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:20.591 15:34:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:20.591 15:34:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:20.591 15:34:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:20.591 15:34:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:20.591 15:34:24 -- paths/export.sh@5 -- # export PATH 00:33:20.591 15:34:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:20.591 15:34:24 -- nvmf/common.sh@47 -- # : 0 00:33:20.591 15:34:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:33:20.591 15:34:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:33:20.591 15:34:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:33:20.591 15:34:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:20.591 15:34:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:20.591 15:34:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:33:20.591 15:34:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:33:20.591 15:34:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:33:20.591 15:34:24 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/app/fio/nvme 00:33:20.591 15:34:24 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:33:20.591 15:34:24 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:33:20.591 15:34:24 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:33:20.591 15:34:24 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:33:20.591 15:34:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:20.591 15:34:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:33:20.591 15:34:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:33:20.591 15:34:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:33:20.591 15:34:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:20.591 15:34:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:33:20.591 15:34:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:20.591 15:34:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:33:20.591 15:34:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:33:20.591 15:34:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:33:20.591 15:34:24 -- common/autotest_common.sh@10 -- # set +x 00:33:28.715 15:34:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:28.715 15:34:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:28.715 15:34:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:28.715 15:34:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:28.715 15:34:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:28.715 15:34:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:28.715 15:34:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:28.715 15:34:31 -- nvmf/common.sh@295 -- # net_devs=() 00:33:28.715 15:34:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:28.715 15:34:31 -- nvmf/common.sh@296 -- # e810=() 00:33:28.715 15:34:31 -- nvmf/common.sh@296 -- # local -ga e810 00:33:28.715 15:34:31 -- nvmf/common.sh@297 -- # x722=() 00:33:28.715 15:34:31 -- nvmf/common.sh@297 -- # local -ga x722 00:33:28.715 15:34:31 -- nvmf/common.sh@298 -- # mlx=() 00:33:28.715 15:34:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:28.715 15:34:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:28.715 15:34:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:28.715 15:34:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:28.715 15:34:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:28.715 15:34:31 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:33:28.715 15:34:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:28.715 15:34:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:28.715 15:34:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:33:28.715 Found 0000:18:00.0 (0x8086 - 0x1592) 00:33:28.715 15:34:31 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:28.715 15:34:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:28.715 15:34:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:28.715 15:34:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:33:28.715 Found 0000:18:00.1 (0x8086 - 0x1592) 00:33:28.716 15:34:31 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:28.716 15:34:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@377 -- # modinfo irdma 00:33:28.716 15:34:31 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:33:28.716 15:34:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:28.716 15:34:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:28.716 15:34:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:33:28.716 Found net devices under 0000:18:00.0: cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:28.716 15:34:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:28.716 15:34:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:28.716 15:34:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:33:28.716 Found net devices under 0000:18:00.1: cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:28.716 15:34:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:28.716 15:34:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:28.716 15:34:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:28.716 15:34:31 -- nvmf/common.sh@58 -- # uname 00:33:28.716 15:34:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:28.716 15:34:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:28.716 15:34:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:28.716 15:34:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:28.716 15:34:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:28.716 15:34:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:28.716 15:34:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:28.716 15:34:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:28.716 15:34:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:28.716 15:34:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:28.716 15:34:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:28.716 15:34:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:28.716 15:34:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:28.716 15:34:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:28.716 15:34:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:28.716 15:34:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@105 -- # continue 2 00:33:28.716 15:34:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@105 -- # continue 2 00:33:28.716 15:34:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:28.716 15:34:31 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:28.716 15:34:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:28.716 15:34:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:33:28.716 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:33:28.716 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:33:28.716 altname enp24s0f0np0 00:33:28.716 altname ens785f0np0 00:33:28.716 inet 192.168.100.8/24 scope global cvl_0_0 00:33:28.716 valid_lft forever preferred_lft forever 00:33:28.716 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:33:28.716 valid_lft forever preferred_lft forever 00:33:28.716 15:34:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:28.716 15:34:31 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:28.716 15:34:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:28.716 15:34:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:33:28.716 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:33:28.716 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:33:28.716 altname enp24s0f1np1 00:33:28.716 altname ens785f1np1 00:33:28.716 inet 192.168.100.9/24 scope global cvl_0_1 00:33:28.716 valid_lft forever preferred_lft forever 00:33:28.716 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:33:28.716 valid_lft forever preferred_lft forever 00:33:28.716 15:34:31 -- nvmf/common.sh@411 -- # return 0 00:33:28.716 15:34:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:28.716 15:34:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:28.716 15:34:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:28.716 15:34:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:28.716 15:34:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:28.716 15:34:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:28.716 15:34:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:28.716 15:34:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:28.716 15:34:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:28.716 15:34:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@105 -- # continue 2 00:33:28.716 15:34:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:28.716 15:34:31 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:33:28.716 15:34:31 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@105 -- # continue 2 00:33:28.716 15:34:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:28.716 15:34:31 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:28.716 15:34:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:28.716 15:34:31 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:28.716 15:34:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:28.716 15:34:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:28.716 192.168.100.9' 00:33:28.716 15:34:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:28.716 192.168.100.9' 00:33:28.716 15:34:31 -- nvmf/common.sh@446 -- # head -n 1 00:33:28.716 15:34:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:28.716 15:34:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:28.716 192.168.100.9' 00:33:28.716 15:34:31 -- nvmf/common.sh@447 -- # tail -n +2 00:33:28.716 15:34:31 -- nvmf/common.sh@447 -- # head -n 1 00:33:28.716 15:34:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:28.716 15:34:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:28.716 15:34:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:28.716 15:34:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:28.716 15:34:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:28.716 15:34:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:28.716 15:34:31 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:33:28.716 15:34:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:28.716 15:34:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:28.716 15:34:31 -- common/autotest_common.sh@10 -- # set +x 00:33:28.716 ************************************ 00:33:28.716 START TEST nvmf_target_disconnect_tc1 00:33:28.716 ************************************ 00:33:28.716 15:34:31 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:33:28.716 15:34:31 -- host/target_disconnect.sh@32 -- # set +e 00:33:28.716 15:34:31 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:28.716 EAL: No free 2048 kB hugepages reported on node 1 00:33:28.716 [2024-04-24 15:34:31.849744] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:28.716 [2024-04-24 15:34:31.849796] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:28.717 [2024-04-24 15:34:31.849806] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:33:28.980 [2024-04-24 15:34:32.852615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:28.980 [2024-04-24 15:34:32.852653] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:33:28.980 [2024-04-24 15:34:32.852664] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:33:28.980 [2024-04-24 15:34:32.852694] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:33:28.980 [2024-04-24 15:34:32.852704] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:33:28.980 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:33:28.980 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:33:28.980 Initializing NVMe Controllers 00:33:28.980 15:34:32 -- host/target_disconnect.sh@33 -- # trap - ERR 00:33:28.980 15:34:32 -- host/target_disconnect.sh@33 -- # print_backtrace 00:33:28.980 15:34:32 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:33:28.980 15:34:32 -- common/autotest_common.sh@1139 -- # return 0 00:33:28.980 15:34:32 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:33:28.980 15:34:32 -- host/target_disconnect.sh@41 -- # set -e 00:33:28.980 00:33:28.980 real 0m1.130s 00:33:28.980 user 0m0.858s 00:33:28.980 sys 0m0.267s 00:33:28.980 15:34:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:28.980 15:34:32 -- common/autotest_common.sh@10 -- # set +x 00:33:28.980 ************************************ 00:33:28.980 END TEST nvmf_target_disconnect_tc1 00:33:28.980 ************************************ 00:33:29.239 15:34:32 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:33:29.239 15:34:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:29.239 15:34:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:29.239 15:34:32 -- common/autotest_common.sh@10 -- # set +x 00:33:29.239 ************************************ 00:33:29.239 START TEST nvmf_target_disconnect_tc2 00:33:29.239 ************************************ 00:33:29.239 15:34:33 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:33:29.239 15:34:33 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:33:29.239 15:34:33 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:29.239 15:34:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:29.239 15:34:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:29.239 15:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:29.239 15:34:33 -- nvmf/common.sh@470 -- # nvmfpid=822072 00:33:29.239 15:34:33 -- nvmf/common.sh@471 -- # waitforlisten 822072 00:33:29.239 15:34:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:29.239 15:34:33 -- common/autotest_common.sh@817 -- # '[' -z 822072 ']' 00:33:29.239 15:34:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:29.239 15:34:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:29.239 15:34:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:29.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:29.239 15:34:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:29.239 15:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:29.239 [2024-04-24 15:34:33.104136] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:29.239 [2024-04-24 15:34:33.104201] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:29.239 EAL: No free 2048 kB hugepages reported on node 1 00:33:29.499 [2024-04-24 15:34:33.200560] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:29.499 [2024-04-24 15:34:33.286182] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:29.499 [2024-04-24 15:34:33.286222] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:29.499 [2024-04-24 15:34:33.286232] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:29.499 [2024-04-24 15:34:33.286241] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:29.499 [2024-04-24 15:34:33.286248] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:29.499 [2024-04-24 15:34:33.286361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:29.499 [2024-04-24 15:34:33.286400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:29.499 [2024-04-24 15:34:33.286515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:29.499 [2024-04-24 15:34:33.286515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:30.067 15:34:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:30.067 15:34:33 -- common/autotest_common.sh@850 -- # return 0 00:33:30.067 15:34:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:30.067 15:34:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:30.067 15:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:30.067 15:34:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:30.067 15:34:33 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:30.067 15:34:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.067 15:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:30.067 Malloc0 00:33:30.067 15:34:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.067 15:34:33 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:30.067 15:34:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.067 15:34:33 -- common/autotest_common.sh@10 -- # set +x 00:33:30.327 [2024-04-24 15:34:33.994864] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1f10830/0x1f0fe70) succeed. 00:33:30.327 [2024-04-24 15:34:34.005790] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1f11be0/0x1f103f0) succeed. 00:33:30.327 [2024-04-24 15:34:34.005814] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:33:30.327 15:34:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.327 15:34:34 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:30.327 15:34:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.327 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:33:30.327 15:34:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.327 15:34:34 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:30.327 15:34:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.327 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:33:30.327 15:34:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.327 15:34:34 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:30.327 15:34:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.327 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:33:30.327 [2024-04-24 15:34:34.034086] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:30.327 15:34:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.327 15:34:34 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:30.327 15:34:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.327 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:33:30.327 15:34:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.327 15:34:34 -- host/target_disconnect.sh@50 -- # reconnectpid=822267 00:33:30.327 15:34:34 -- host/target_disconnect.sh@52 -- # sleep 2 00:33:30.327 15:34:34 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:30.327 EAL: No free 2048 kB hugepages reported on node 1 00:33:32.293 15:34:36 -- host/target_disconnect.sh@53 -- # kill -9 822072 00:33:32.293 15:34:36 -- host/target_disconnect.sh@55 -- # sleep 2 00:33:33.231 [2024-04-24 15:34:36.787498] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Write completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 Read completed with error (sct=0, sc=8) 00:33:33.231 starting I/O failed 00:33:33.231 [2024-04-24 15:34:36.788080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.231 [2024-04-24 15:34:36.789895] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:33.231 [2024-04-24 15:34:36.789915] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:33.231 [2024-04-24 15:34:36.789923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.170 [2024-04-24 15:34:37.792622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.170 qpair failed and we were unable to recover it. 00:33:34.170 [2024-04-24 15:34:37.794426] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:34.170 [2024-04-24 15:34:37.794445] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:34.170 [2024-04-24 15:34:37.794454] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.170 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 822072 Killed "${NVMF_APP[@]}" "$@" 00:33:34.170 15:34:38 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:33:34.170 15:34:38 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:34.170 15:34:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:34.170 15:34:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:34.170 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:33:34.170 15:34:38 -- nvmf/common.sh@470 -- # nvmfpid=822797 00:33:34.170 15:34:38 -- nvmf/common.sh@471 -- # waitforlisten 822797 00:33:34.170 15:34:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:34.170 15:34:38 -- common/autotest_common.sh@817 -- # '[' -z 822797 ']' 00:33:34.170 15:34:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:34.170 15:34:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:34.170 15:34:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:34.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:34.170 15:34:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:34.170 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:33:34.429 [2024-04-24 15:34:38.113794] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:34.430 [2024-04-24 15:34:38.113847] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:34.430 EAL: No free 2048 kB hugepages reported on node 1 00:33:34.430 [2024-04-24 15:34:38.207932] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:34.430 [2024-04-24 15:34:38.290200] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:34.430 [2024-04-24 15:34:38.290247] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:34.430 [2024-04-24 15:34:38.290257] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:34.430 [2024-04-24 15:34:38.290266] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:34.430 [2024-04-24 15:34:38.290273] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:34.430 [2024-04-24 15:34:38.290386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:34.430 [2024-04-24 15:34:38.290508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:34.430 [2024-04-24 15:34:38.290581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:34.430 [2024-04-24 15:34:38.290583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:34.998 [2024-04-24 15:34:38.797208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.998 qpair failed and we were unable to recover it. 00:33:34.998 [2024-04-24 15:34:38.799092] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:34.998 [2024-04-24 15:34:38.799112] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:34.998 [2024-04-24 15:34:38.799120] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.256 15:34:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:35.257 15:34:38 -- common/autotest_common.sh@850 -- # return 0 00:33:35.257 15:34:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:35.257 15:34:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:35.257 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 15:34:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:35.257 15:34:38 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:35.257 15:34:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 Malloc0 00:33:35.257 15:34:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:38 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:35.257 15:34:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 [2024-04-24 15:34:39.006809] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0xdc0830/0xdbfe70) succeed. 00:33:35.257 [2024-04-24 15:34:39.017704] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0xdc1be0/0xdc03f0) succeed. 00:33:35.257 [2024-04-24 15:34:39.017727] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:33:35.257 15:34:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:39 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:35.257 15:34:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 15:34:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:39 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:35.257 15:34:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 15:34:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:39 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:35.257 15:34:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 [2024-04-24 15:34:39.046008] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:35.257 15:34:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:39 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:35.257 15:34:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:35.257 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:33:35.257 15:34:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:35.257 15:34:39 -- host/target_disconnect.sh@58 -- # wait 822267 00:33:36.196 [2024-04-24 15:34:39.801859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.196 qpair failed and we were unable to recover it. 00:33:36.196 [2024-04-24 15:34:39.813422] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.196 [2024-04-24 15:34:39.813495] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.813516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.813528] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.813538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.821731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.833322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.833370] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.833389] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.833399] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.833409] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.841763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.853367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.853407] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.853425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.853435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.853444] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.861812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.873410] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.873459] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.873477] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.873491] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.873501] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.881933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.893417] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.893461] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.893479] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.893493] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.893503] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.901950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.913467] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.913514] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.913531] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.913541] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.913550] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.921969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.933520] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.933560] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.933581] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.933591] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.933600] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.942013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.953622] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.953672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.953689] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.953699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.953709] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.962084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.973652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.973702] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.973719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.973729] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.973738] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:39.982191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:39.993691] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:39.993736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:39.993753] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:39.993763] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:39.993773] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:40.002233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:40.013750] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:40.013792] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:40.013814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:40.013825] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:40.013835] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:40.022232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:40.033734] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:40.033783] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:40.033801] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:40.033812] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:40.033822] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:40.042386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:40.053944] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:40.053999] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.197 [2024-04-24 15:34:40.054024] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.197 [2024-04-24 15:34:40.054036] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.197 [2024-04-24 15:34:40.054046] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.197 [2024-04-24 15:34:40.062363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.197 qpair failed and we were unable to recover it. 00:33:36.197 [2024-04-24 15:34:40.073742] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.197 [2024-04-24 15:34:40.073785] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.198 [2024-04-24 15:34:40.073802] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.198 [2024-04-24 15:34:40.073812] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.198 [2024-04-24 15:34:40.073821] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.198 [2024-04-24 15:34:40.082381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.198 qpair failed and we were unable to recover it. 00:33:36.198 [2024-04-24 15:34:40.093897] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.198 [2024-04-24 15:34:40.093943] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.198 [2024-04-24 15:34:40.093960] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.198 [2024-04-24 15:34:40.093970] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.198 [2024-04-24 15:34:40.093980] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.198 [2024-04-24 15:34:40.102394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.198 qpair failed and we were unable to recover it. 00:33:36.457 [2024-04-24 15:34:40.113907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.457 [2024-04-24 15:34:40.113959] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.457 [2024-04-24 15:34:40.113976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.457 [2024-04-24 15:34:40.113986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.457 [2024-04-24 15:34:40.113996] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.457 [2024-04-24 15:34:40.122549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.457 qpair failed and we were unable to recover it. 00:33:36.457 [2024-04-24 15:34:40.134089] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.134131] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.134147] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.134156] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.134165] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.142631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.153970] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.154020] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.154036] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.154046] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.154056] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.162680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.174172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.174215] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.174231] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.174241] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.174250] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.182662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.194168] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.194216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.194233] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.194246] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.194256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.202748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.214250] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.214298] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.214314] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.214324] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.214333] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.222823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.234353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.234398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.234414] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.234424] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.234433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.242865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.254371] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.254419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.254436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.254446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.254455] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.262867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.274408] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.274454] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.274471] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.274481] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.274494] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.283006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.294565] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.294613] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.294629] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.294639] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.294648] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.303070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.314604] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.314647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.314663] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.314673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.314682] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.323201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.334669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.334709] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.334725] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.334735] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.334745] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.343180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.458 [2024-04-24 15:34:40.354658] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.458 [2024-04-24 15:34:40.354701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.458 [2024-04-24 15:34:40.354717] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.458 [2024-04-24 15:34:40.354727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.458 [2024-04-24 15:34:40.354736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.458 [2024-04-24 15:34:40.363333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.458 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.374699] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.374749] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.374769] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.374779] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.374788] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.383299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.394844] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.394884] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.394901] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.394910] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.394919] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.403369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.414929] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.414972] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.414989] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.415000] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.415009] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.423441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.434947] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.434994] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.435010] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.435019] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.435028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.443550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.455084] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.455136] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.455152] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.455162] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.455171] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.463558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.718 [2024-04-24 15:34:40.475118] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.718 [2024-04-24 15:34:40.475160] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.718 [2024-04-24 15:34:40.475176] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.718 [2024-04-24 15:34:40.475186] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.718 [2024-04-24 15:34:40.475195] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.718 [2024-04-24 15:34:40.483659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.718 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.495132] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.495175] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.495192] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.495201] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.495211] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.503680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.515164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.515209] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.515224] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.515234] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.515244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.523730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.535264] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.535312] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.535328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.535338] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.535347] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.543818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.555286] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.555333] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.555349] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.555359] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.555368] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.563897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.575326] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.575366] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.575382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.575392] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.575401] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.583945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.595446] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.595504] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.595521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.595531] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.595540] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.603987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.719 [2024-04-24 15:34:40.615495] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.719 [2024-04-24 15:34:40.615543] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.719 [2024-04-24 15:34:40.615560] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.719 [2024-04-24 15:34:40.615569] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.719 [2024-04-24 15:34:40.615579] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.719 [2024-04-24 15:34:40.624056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.719 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.635647] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.635692] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.635709] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.635722] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.635731] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.644065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.655629] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.655673] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.655689] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.655699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.655708] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.664153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.675706] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.675750] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.675766] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.675775] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.675784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.684267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.695730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.695777] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.695793] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.695803] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.695813] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.704315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.715761] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.715802] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.715818] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.715828] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.715837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.724366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.735867] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.735907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.735925] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.735935] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.735944] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.744383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.755905] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.755949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.755966] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.755976] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.980 [2024-04-24 15:34:40.755986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.980 [2024-04-24 15:34:40.764475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.980 qpair failed and we were unable to recover it. 00:33:36.980 [2024-04-24 15:34:40.775909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.980 [2024-04-24 15:34:40.775960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.980 [2024-04-24 15:34:40.775976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.980 [2024-04-24 15:34:40.775986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.775996] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.784480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:36.981 [2024-04-24 15:34:40.796042] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.981 [2024-04-24 15:34:40.796084] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.981 [2024-04-24 15:34:40.796101] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.981 [2024-04-24 15:34:40.796111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.796120] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.804569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:36.981 [2024-04-24 15:34:40.816090] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.981 [2024-04-24 15:34:40.816135] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.981 [2024-04-24 15:34:40.816155] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.981 [2024-04-24 15:34:40.816165] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.816174] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.824649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:36.981 [2024-04-24 15:34:40.836088] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.981 [2024-04-24 15:34:40.836136] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.981 [2024-04-24 15:34:40.836154] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.981 [2024-04-24 15:34:40.836163] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.836173] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.844691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:36.981 [2024-04-24 15:34:40.856223] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.981 [2024-04-24 15:34:40.856268] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.981 [2024-04-24 15:34:40.856285] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.981 [2024-04-24 15:34:40.856294] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.856303] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.864742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:36.981 [2024-04-24 15:34:40.876218] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.981 [2024-04-24 15:34:40.876261] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.981 [2024-04-24 15:34:40.876277] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.981 [2024-04-24 15:34:40.876287] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.981 [2024-04-24 15:34:40.876296] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.981 [2024-04-24 15:34:40.884856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.981 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.896295] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.896340] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.896356] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.896366] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.896377] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:40.904890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.916440] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.916488] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.916504] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.916513] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.916523] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:40.924961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.936477] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.936523] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.936539] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.936548] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.936558] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:40.945032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.956552] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.956590] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.956607] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.956616] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.956626] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:40.965042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.976685] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.976726] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.976742] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.976752] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.976762] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:40.985085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:40.996669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:40.996717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:40.996733] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:40.996743] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:40.996752] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:41.005229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:41.016718] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:41.016761] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:41.016777] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:41.016787] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:41.016797] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:41.025265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:41.036728] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:41.036773] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:41.036789] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:41.036799] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:41.036808] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:41.045285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.241 qpair failed and we were unable to recover it. 00:33:37.241 [2024-04-24 15:34:41.056781] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.241 [2024-04-24 15:34:41.056819] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.241 [2024-04-24 15:34:41.056835] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.241 [2024-04-24 15:34:41.056845] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.241 [2024-04-24 15:34:41.056854] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.241 [2024-04-24 15:34:41.065408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.242 qpair failed and we were unable to recover it. 00:33:37.242 [2024-04-24 15:34:41.076838] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.242 [2024-04-24 15:34:41.076882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.242 [2024-04-24 15:34:41.076899] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.242 [2024-04-24 15:34:41.076914] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.242 [2024-04-24 15:34:41.076923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.242 [2024-04-24 15:34:41.085496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.242 qpair failed and we were unable to recover it. 00:33:37.242 [2024-04-24 15:34:41.096948] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.242 [2024-04-24 15:34:41.096997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.242 [2024-04-24 15:34:41.097013] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.242 [2024-04-24 15:34:41.097024] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.242 [2024-04-24 15:34:41.097033] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.242 [2024-04-24 15:34:41.105457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.242 qpair failed and we were unable to recover it. 00:33:37.242 [2024-04-24 15:34:41.117013] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.242 [2024-04-24 15:34:41.117050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.242 [2024-04-24 15:34:41.117066] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.242 [2024-04-24 15:34:41.117075] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.242 [2024-04-24 15:34:41.117084] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.242 [2024-04-24 15:34:41.125541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.242 qpair failed and we were unable to recover it. 00:33:37.242 [2024-04-24 15:34:41.137049] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.242 [2024-04-24 15:34:41.137089] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.242 [2024-04-24 15:34:41.137106] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.242 [2024-04-24 15:34:41.137115] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.242 [2024-04-24 15:34:41.137125] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.242 [2024-04-24 15:34:41.145567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.242 qpair failed and we were unable to recover it. 00:33:37.502 [2024-04-24 15:34:41.157159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.502 [2024-04-24 15:34:41.157204] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.502 [2024-04-24 15:34:41.157220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.502 [2024-04-24 15:34:41.157230] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.502 [2024-04-24 15:34:41.157240] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.502 [2024-04-24 15:34:41.165681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.502 qpair failed and we were unable to recover it. 00:33:37.502 [2024-04-24 15:34:41.177205] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.502 [2024-04-24 15:34:41.177249] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.502 [2024-04-24 15:34:41.177265] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.502 [2024-04-24 15:34:41.177275] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.502 [2024-04-24 15:34:41.177284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.502 [2024-04-24 15:34:41.185679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.502 qpair failed and we were unable to recover it. 00:33:37.502 [2024-04-24 15:34:41.197268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.502 [2024-04-24 15:34:41.197309] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.502 [2024-04-24 15:34:41.197325] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.502 [2024-04-24 15:34:41.197335] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.502 [2024-04-24 15:34:41.197344] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.502 [2024-04-24 15:34:41.205694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.502 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.217310] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.217350] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.217366] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.217376] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.217386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.225830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.237356] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.237398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.237414] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.237424] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.237433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.245899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.257418] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.257463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.257482] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.257496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.257504] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.266008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.277514] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.277558] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.277575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.277584] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.277594] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.285975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.297557] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.297601] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.297617] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.297627] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.297636] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.306101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.317740] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.317798] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.317815] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.317825] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.317834] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.326146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.337729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.337773] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.337789] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.337799] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.337808] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.346242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.357787] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.357830] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.357846] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.357856] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.357865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.366270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.377836] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.377878] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.377894] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.377904] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.377913] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.386291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.503 [2024-04-24 15:34:41.397862] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.503 [2024-04-24 15:34:41.397906] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.503 [2024-04-24 15:34:41.397922] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.503 [2024-04-24 15:34:41.397932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.503 [2024-04-24 15:34:41.397941] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.503 [2024-04-24 15:34:41.406397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.503 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.417895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.417942] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.417958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.417968] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.417978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.426405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.437897] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.437943] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.437959] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.437969] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.437978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.446498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.457953] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.457994] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.458010] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.458019] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.458028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.466584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.478077] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.478122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.478138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.478147] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.478156] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.486573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.498148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.498197] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.498214] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.498224] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.498234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.506661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.518200] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.518247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.518263] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.518276] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.518286] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.526769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.538248] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.538293] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.764 [2024-04-24 15:34:41.538309] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.764 [2024-04-24 15:34:41.538319] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.764 [2024-04-24 15:34:41.538328] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.764 [2024-04-24 15:34:41.546802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.764 qpair failed and we were unable to recover it. 00:33:37.764 [2024-04-24 15:34:41.558333] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.764 [2024-04-24 15:34:41.558377] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.558393] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.558403] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.558412] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.566860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:37.765 [2024-04-24 15:34:41.578382] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.765 [2024-04-24 15:34:41.578428] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.578444] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.578454] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.578462] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.586892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:37.765 [2024-04-24 15:34:41.598460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.765 [2024-04-24 15:34:41.598508] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.598525] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.598535] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.598545] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.606953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:37.765 [2024-04-24 15:34:41.618511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.765 [2024-04-24 15:34:41.618551] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.618567] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.618577] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.618587] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.627003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:37.765 [2024-04-24 15:34:41.638558] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.765 [2024-04-24 15:34:41.638603] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.638619] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.638628] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.638638] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.647071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:37.765 [2024-04-24 15:34:41.658628] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.765 [2024-04-24 15:34:41.658675] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.765 [2024-04-24 15:34:41.658692] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.765 [2024-04-24 15:34:41.658701] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.765 [2024-04-24 15:34:41.658711] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:37.765 [2024-04-24 15:34:41.667197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:37.765 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.678677] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.678718] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.678735] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.678745] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.678754] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.687228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.698732] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.698771] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.698792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.698801] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.698810] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.707230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.718816] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.718858] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.718874] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.718884] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.718893] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.727290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.738739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.738787] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.738805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.738815] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.738825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.747366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.758899] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.758941] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.758958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.758968] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.758977] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.767431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.778947] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.778992] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.779008] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.779018] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.779027] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.787482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.798995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.799040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.799057] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.799067] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.026 [2024-04-24 15:34:41.799076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.026 [2024-04-24 15:34:41.807596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.026 qpair failed and we were unable to recover it. 00:33:38.026 [2024-04-24 15:34:41.819023] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.026 [2024-04-24 15:34:41.819066] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.026 [2024-04-24 15:34:41.819084] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.026 [2024-04-24 15:34:41.819093] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.819103] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.827561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.027 [2024-04-24 15:34:41.839169] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.027 [2024-04-24 15:34:41.839210] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.027 [2024-04-24 15:34:41.839228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.027 [2024-04-24 15:34:41.839238] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.839249] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.847706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.027 [2024-04-24 15:34:41.859214] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.027 [2024-04-24 15:34:41.859257] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.027 [2024-04-24 15:34:41.859274] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.027 [2024-04-24 15:34:41.859284] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.859294] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.867714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.027 [2024-04-24 15:34:41.879252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.027 [2024-04-24 15:34:41.879301] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.027 [2024-04-24 15:34:41.879319] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.027 [2024-04-24 15:34:41.879329] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.879338] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.887792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.027 [2024-04-24 15:34:41.899332] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.027 [2024-04-24 15:34:41.899374] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.027 [2024-04-24 15:34:41.899390] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.027 [2024-04-24 15:34:41.899400] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.899409] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.907894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.027 [2024-04-24 15:34:41.919391] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.027 [2024-04-24 15:34:41.919430] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.027 [2024-04-24 15:34:41.919448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.027 [2024-04-24 15:34:41.919458] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.027 [2024-04-24 15:34:41.919468] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.027 [2024-04-24 15:34:41.927920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.027 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:41.939419] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:41.939467] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:41.939483] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:41.939498] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:41.939508] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:41.948021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:41.959537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:41.959585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:41.959602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:41.959616] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:41.959626] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:41.968080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:41.979593] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:41.979638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:41.979654] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:41.979664] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:41.979674] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:41.988145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:41.999634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:41.999673] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:41.999689] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:41.999699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:41.999708] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.008133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.019680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.019724] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.019740] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.019751] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.019760] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.028185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.039781] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.039827] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.039843] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.039853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.039862] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.048318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.059763] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.059807] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.059823] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.059833] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.059842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.068317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.079837] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.079880] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.079896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.079906] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.079915] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.088422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.099949] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.099996] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.100013] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.100023] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.100032] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.288 [2024-04-24 15:34:42.108450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.288 qpair failed and we were unable to recover it. 00:33:38.288 [2024-04-24 15:34:42.119995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.288 [2024-04-24 15:34:42.120042] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.288 [2024-04-24 15:34:42.120058] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.288 [2024-04-24 15:34:42.120068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.288 [2024-04-24 15:34:42.120078] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.289 [2024-04-24 15:34:42.128514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.289 qpair failed and we were unable to recover it. 00:33:38.289 [2024-04-24 15:34:42.140060] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.289 [2024-04-24 15:34:42.140105] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.289 [2024-04-24 15:34:42.140124] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.289 [2024-04-24 15:34:42.140134] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.289 [2024-04-24 15:34:42.140143] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.289 [2024-04-24 15:34:42.148647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.289 qpair failed and we were unable to recover it. 00:33:38.289 [2024-04-24 15:34:42.160142] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.289 [2024-04-24 15:34:42.160187] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.289 [2024-04-24 15:34:42.160203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.289 [2024-04-24 15:34:42.160213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.289 [2024-04-24 15:34:42.160222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.289 [2024-04-24 15:34:42.168702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.289 qpair failed and we were unable to recover it. 00:33:38.289 [2024-04-24 15:34:42.180170] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.289 [2024-04-24 15:34:42.180209] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.289 [2024-04-24 15:34:42.180225] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.289 [2024-04-24 15:34:42.180234] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.289 [2024-04-24 15:34:42.180243] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.289 [2024-04-24 15:34:42.188709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.289 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.200236] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.200280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.200298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.200309] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.200318] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.208800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.220246] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.220293] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.220310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.220319] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.220329] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.228898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.240320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.240367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.240383] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.240393] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.240403] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.248946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.260436] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.260482] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.260503] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.260514] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.260523] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.269005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.280586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.280632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.280648] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.280657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.280667] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.288997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.300568] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.300615] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.300631] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.300640] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.300650] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.309047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.320622] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.320667] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.320683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.320693] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.320702] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.329145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.340672] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.340714] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.340730] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.340739] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.340749] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.349196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.360744] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.360789] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.360805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.360816] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.360826] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.369296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.380743] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.380786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.380801] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.380811] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.380820] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.389337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.400889] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.400932] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.400948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.400964] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.400973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.409401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.549 [2024-04-24 15:34:42.420906] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.549 [2024-04-24 15:34:42.420948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.549 [2024-04-24 15:34:42.420965] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.549 [2024-04-24 15:34:42.420975] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.549 [2024-04-24 15:34:42.420984] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.549 [2024-04-24 15:34:42.429419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.549 qpair failed and we were unable to recover it. 00:33:38.550 [2024-04-24 15:34:42.440968] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.550 [2024-04-24 15:34:42.441012] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.550 [2024-04-24 15:34:42.441029] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.550 [2024-04-24 15:34:42.441038] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.550 [2024-04-24 15:34:42.441047] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.550 [2024-04-24 15:34:42.449466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.550 qpair failed and we were unable to recover it. 00:33:38.550 [2024-04-24 15:34:42.460984] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.550 [2024-04-24 15:34:42.461028] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.550 [2024-04-24 15:34:42.461044] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.550 [2024-04-24 15:34:42.461054] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.550 [2024-04-24 15:34:42.461063] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.809 [2024-04-24 15:34:42.469570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.809 qpair failed and we were unable to recover it. 00:33:38.809 [2024-04-24 15:34:42.481071] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.809 [2024-04-24 15:34:42.481115] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.809 [2024-04-24 15:34:42.481132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.809 [2024-04-24 15:34:42.481143] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.809 [2024-04-24 15:34:42.481152] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.809 [2024-04-24 15:34:42.489596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.809 qpair failed and we were unable to recover it. 00:33:38.809 [2024-04-24 15:34:42.501150] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.501188] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.501203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.501213] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.501222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.509702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.521172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.521215] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.521231] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.521241] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.521250] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.529727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.541254] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.541303] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.541319] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.541329] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.541338] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.549734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.561334] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.561378] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.561394] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.561403] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.561413] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.569832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.581376] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.581414] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.581433] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.581443] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.581452] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.589957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.601400] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.601442] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.601459] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.601468] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.601477] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.610003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.621577] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.621624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.621640] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.621649] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.621659] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.630066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.641539] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.641582] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.641598] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.641608] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.641617] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.650060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.661608] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.661647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.661663] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.661673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.661682] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.670111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.681620] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.681664] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.681680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.681689] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.681699] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.690213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.701715] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.701758] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.701774] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.701783] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.701793] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:38.810 [2024-04-24 15:34:42.710255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:38.810 qpair failed and we were unable to recover it. 00:33:38.810 [2024-04-24 15:34:42.721761] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.810 [2024-04-24 15:34:42.721798] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.810 [2024-04-24 15:34:42.721814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.810 [2024-04-24 15:34:42.721823] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.810 [2024-04-24 15:34:42.721832] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.070 [2024-04-24 15:34:42.730309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.070 qpair failed and we were unable to recover it. 00:33:39.070 [2024-04-24 15:34:42.741862] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.070 [2024-04-24 15:34:42.741909] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.070 [2024-04-24 15:34:42.741926] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.070 [2024-04-24 15:34:42.741936] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.070 [2024-04-24 15:34:42.741946] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.070 [2024-04-24 15:34:42.750304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.070 qpair failed and we were unable to recover it. 00:33:39.070 [2024-04-24 15:34:42.761878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.070 [2024-04-24 15:34:42.761923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.070 [2024-04-24 15:34:42.761939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.070 [2024-04-24 15:34:42.761949] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.070 [2024-04-24 15:34:42.761958] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.070 [2024-04-24 15:34:42.770417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.070 qpair failed and we were unable to recover it. 00:33:39.070 [2024-04-24 15:34:42.781903] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.070 [2024-04-24 15:34:42.781946] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.781962] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.781972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.781981] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.790432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.801994] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.802035] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.802052] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.802061] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.802070] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.810496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.822054] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.822095] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.822112] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.822121] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.822130] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.830592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.842128] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.842175] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.842191] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.842204] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.842213] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.850664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.862165] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.862214] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.862230] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.862240] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.862249] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.870709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.882174] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.882212] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.882228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.882238] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.882247] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.890750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.902281] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.902323] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.902339] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.902349] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.902358] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.910819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.922353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.922398] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.922414] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.922423] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.922433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.930907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.942367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.942409] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.942425] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.942435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.942444] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.950973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.962422] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.962462] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.962480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.962495] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.962505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.071 [2024-04-24 15:34:42.970983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.071 qpair failed and we were unable to recover it. 00:33:39.071 [2024-04-24 15:34:42.982518] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.071 [2024-04-24 15:34:42.982559] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.071 [2024-04-24 15:34:42.982576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.071 [2024-04-24 15:34:42.982585] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.071 [2024-04-24 15:34:42.982595] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:42.991078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.002683] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.002727] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.002744] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.002754] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.002763] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.011149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.022638] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.022684] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.022704] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.022713] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.022723] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.031130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.042704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.042744] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.042761] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.042770] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.042780] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.051205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.062783] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.062825] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.062841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.062851] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.062862] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.071250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.082808] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.082851] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.082867] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.082877] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.082886] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.091351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.102812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.102858] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.102875] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.102885] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.102897] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.111436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.122966] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.123010] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.123027] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.123037] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.123046] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.131456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.143023] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.143063] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.143079] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.143089] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.143098] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.151540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.163059] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.163103] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.163119] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.163129] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.163139] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.171603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.183115] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.183162] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.183178] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.183188] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.183197] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.191690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.203197] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.203242] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.203259] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.203268] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.203277] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.332 [2024-04-24 15:34:43.211662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.332 qpair failed and we were unable to recover it. 00:33:39.332 [2024-04-24 15:34:43.223169] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.332 [2024-04-24 15:34:43.223211] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.332 [2024-04-24 15:34:43.223228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.332 [2024-04-24 15:34:43.223238] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.332 [2024-04-24 15:34:43.223247] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.333 [2024-04-24 15:34:43.231823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.333 qpair failed and we were unable to recover it. 00:33:39.333 [2024-04-24 15:34:43.243314] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.333 [2024-04-24 15:34:43.243356] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.333 [2024-04-24 15:34:43.243372] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.333 [2024-04-24 15:34:43.243382] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.333 [2024-04-24 15:34:43.243391] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.251821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.263351] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.263395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.263412] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.263422] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.263431] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.271915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.283348] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.283390] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.283406] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.283419] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.283429] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.291978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.303462] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.303506] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.303523] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.303533] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.303543] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.311965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.323547] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.323591] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.323607] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.323617] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.323626] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.332091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.343581] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.343626] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.343641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.343651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.343661] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.352161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.363676] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.363720] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.363736] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.363746] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.363756] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.372211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.383718] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.383765] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.383781] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.383791] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.383800] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.392134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.403755] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.403801] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.403818] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.403828] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.403837] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.412267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.423802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.423848] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.423864] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.423873] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.423883] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.432360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.443854] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.443894] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.443910] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.443921] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.443930] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.452419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.463957] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.463997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.464017] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.464027] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.464036] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.472476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.484028] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.593 [2024-04-24 15:34:43.484074] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.593 [2024-04-24 15:34:43.484090] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.593 [2024-04-24 15:34:43.484100] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.593 [2024-04-24 15:34:43.484109] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.593 [2024-04-24 15:34:43.492549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.593 qpair failed and we were unable to recover it. 00:33:39.593 [2024-04-24 15:34:43.504070] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.594 [2024-04-24 15:34:43.504119] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.594 [2024-04-24 15:34:43.504136] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.594 [2024-04-24 15:34:43.504145] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.594 [2024-04-24 15:34:43.504155] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.512624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.524121] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.524165] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.524181] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.524191] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.524200] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.532647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.544202] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.544241] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.544257] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.544267] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.544279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.552768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.564266] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.564311] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.564328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.564337] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.564346] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.572751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.584296] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.584344] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.584360] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.584369] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.584378] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.592889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.604428] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.604472] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.604491] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.604502] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.604511] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.612814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.624395] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.624436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.624452] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.624461] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.624470] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.632918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.644454] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.644503] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.644520] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.854 [2024-04-24 15:34:43.644529] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.854 [2024-04-24 15:34:43.644538] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.854 [2024-04-24 15:34:43.652978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.854 qpair failed and we were unable to recover it. 00:33:39.854 [2024-04-24 15:34:43.664532] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.854 [2024-04-24 15:34:43.664577] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.854 [2024-04-24 15:34:43.664593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.664602] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.664611] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.855 [2024-04-24 15:34:43.673056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.855 qpair failed and we were unable to recover it. 00:33:39.855 [2024-04-24 15:34:43.684594] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.855 [2024-04-24 15:34:43.684638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.855 [2024-04-24 15:34:43.684653] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.684663] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.684672] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.855 [2024-04-24 15:34:43.693137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.855 qpair failed and we were unable to recover it. 00:33:39.855 [2024-04-24 15:34:43.704654] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.855 [2024-04-24 15:34:43.704695] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.855 [2024-04-24 15:34:43.704711] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.704721] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.704730] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.855 [2024-04-24 15:34:43.713204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.855 qpair failed and we were unable to recover it. 00:33:39.855 [2024-04-24 15:34:43.724733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.855 [2024-04-24 15:34:43.724776] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.855 [2024-04-24 15:34:43.724792] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.724805] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.724814] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.855 [2024-04-24 15:34:43.733280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.855 qpair failed and we were unable to recover it. 00:33:39.855 [2024-04-24 15:34:43.744712] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.855 [2024-04-24 15:34:43.744758] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.855 [2024-04-24 15:34:43.744775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.744785] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.744794] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:39.855 [2024-04-24 15:34:43.753320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:39.855 qpair failed and we were unable to recover it. 00:33:39.855 [2024-04-24 15:34:43.764802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:39.855 [2024-04-24 15:34:43.764849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:39.855 [2024-04-24 15:34:43.764865] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:39.855 [2024-04-24 15:34:43.764875] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:39.855 [2024-04-24 15:34:43.764884] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.773341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.784887] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.784925] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.784942] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.784952] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.784961] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.793393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.804961] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.805004] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.805020] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.805030] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.805039] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.813452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.824994] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.825040] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.825056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.825066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.825075] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.833515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.845053] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.845094] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.845110] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.845120] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.845129] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.853585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.865126] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.865166] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.865181] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.865191] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.865200] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.873659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.885169] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.885212] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.885228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.885237] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.885246] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.115 [2024-04-24 15:34:43.893709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.115 qpair failed and we were unable to recover it. 00:33:40.115 [2024-04-24 15:34:43.905216] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.115 [2024-04-24 15:34:43.905264] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.115 [2024-04-24 15:34:43.905283] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.115 [2024-04-24 15:34:43.905293] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.115 [2024-04-24 15:34:43.905303] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:43.913826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:43.925288] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:43.925328] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:43.925343] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:43.925353] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:43.925362] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:43.933865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:43.945437] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:43.945481] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:43.945501] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:43.945510] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:43.945519] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:43.953908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:43.965498] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:43.965542] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:43.965558] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:43.965568] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:43.965577] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:43.974025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:43.985570] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:43.985622] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:43.985637] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:43.985647] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:43.985663] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:43.994063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:44.005578] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:44.005624] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:44.005641] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:44.005652] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:44.005660] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.116 [2024-04-24 15:34:44.014124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.116 qpair failed and we were unable to recover it. 00:33:40.116 [2024-04-24 15:34:44.025736] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.116 [2024-04-24 15:34:44.025781] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.116 [2024-04-24 15:34:44.025798] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.116 [2024-04-24 15:34:44.025808] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.116 [2024-04-24 15:34:44.025818] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.034204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.045636] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.045680] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.045697] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.045706] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.045716] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.054222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.065759] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.065807] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.065823] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.065833] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.065843] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.074318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.085786] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.085834] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.085851] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.085861] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.085870] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.094319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.105845] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.105890] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.105906] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.105916] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.105924] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.114388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.125971] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.126016] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.126032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.126042] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.126050] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.134475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.145978] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.146030] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.146047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.146057] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.146066] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.154551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.165993] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.166039] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.166055] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.166068] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.166078] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.174612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.186120] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.186158] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.186174] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.186184] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.186193] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.377 [2024-04-24 15:34:44.194667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.377 qpair failed and we were unable to recover it. 00:33:40.377 [2024-04-24 15:34:44.206159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.377 [2024-04-24 15:34:44.206204] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.377 [2024-04-24 15:34:44.206220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.377 [2024-04-24 15:34:44.206230] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.377 [2024-04-24 15:34:44.206239] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.378 [2024-04-24 15:34:44.214662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.378 qpair failed and we were unable to recover it. 00:33:40.378 [2024-04-24 15:34:44.226198] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.378 [2024-04-24 15:34:44.226246] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.378 [2024-04-24 15:34:44.226262] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.378 [2024-04-24 15:34:44.226272] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.378 [2024-04-24 15:34:44.226281] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.378 [2024-04-24 15:34:44.234723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.378 qpair failed and we were unable to recover it. 00:33:40.378 [2024-04-24 15:34:44.246279] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.378 [2024-04-24 15:34:44.246319] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.378 [2024-04-24 15:34:44.246335] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.378 [2024-04-24 15:34:44.246344] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.378 [2024-04-24 15:34:44.246353] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.378 [2024-04-24 15:34:44.254814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.378 qpair failed and we were unable to recover it. 00:33:40.378 [2024-04-24 15:34:44.266292] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.378 [2024-04-24 15:34:44.266335] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.378 [2024-04-24 15:34:44.266351] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.378 [2024-04-24 15:34:44.266361] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.378 [2024-04-24 15:34:44.266370] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.378 [2024-04-24 15:34:44.274872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.378 qpair failed and we were unable to recover it. 00:33:40.378 [2024-04-24 15:34:44.286403] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:40.378 [2024-04-24 15:34:44.286446] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:40.378 [2024-04-24 15:34:44.286463] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:40.378 [2024-04-24 15:34:44.286472] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:40.378 [2024-04-24 15:34:44.286482] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:40.637 [2024-04-24 15:34:44.294977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:40.637 qpair failed and we were unable to recover it. 00:33:40.637 [2024-04-24 15:34:44.295072] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:33:40.637 A controller has encountered a failure and is being reset. 00:33:40.637 [2024-04-24 15:34:44.295205] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:40.637 [2024-04-24 15:34:44.295628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:40.637 Controller properly reset. 00:33:41.206 [2024-04-24 15:34:44.853499] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Write completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 Read completed with error (sct=0, sc=8) 00:33:41.206 starting I/O failed 00:33:41.206 [2024-04-24 15:34:44.854046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:41.776 [2024-04-24 15:34:45.428497] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Write completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 Read completed with error (sct=0, sc=8) 00:33:41.776 starting I/O failed 00:33:41.776 [2024-04-24 15:34:45.429017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:42.345 [2024-04-24 15:34:46.005499] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Write completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.345 Read completed with error (sct=0, sc=8) 00:33:42.345 starting I/O failed 00:33:42.346 Write completed with error (sct=0, sc=8) 00:33:42.346 starting I/O failed 00:33:42.346 [2024-04-24 15:34:46.006031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:42.346 Initializing NVMe Controllers 00:33:42.346 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:42.346 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:42.346 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:33:42.346 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:33:42.346 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:33:42.346 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:33:42.346 Initialization complete. Launching workers. 00:33:42.346 Starting thread on core 1 00:33:42.346 Starting thread on core 2 00:33:42.346 Starting thread on core 3 00:33:42.346 Starting thread on core 0 00:33:42.346 15:34:46 -- host/target_disconnect.sh@59 -- # sync 00:33:42.346 00:33:42.346 real 0m13.001s 00:33:42.346 user 0m27.465s 00:33:42.346 sys 0m4.178s 00:33:42.346 15:34:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:42.346 15:34:46 -- common/autotest_common.sh@10 -- # set +x 00:33:42.346 ************************************ 00:33:42.346 END TEST nvmf_target_disconnect_tc2 00:33:42.346 ************************************ 00:33:42.346 15:34:46 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:33:42.346 15:34:46 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:33:42.346 15:34:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:42.346 15:34:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:42.346 15:34:46 -- common/autotest_common.sh@10 -- # set +x 00:33:42.605 ************************************ 00:33:42.605 START TEST nvmf_target_disconnect_tc3 00:33:42.605 ************************************ 00:33:42.605 15:34:46 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:33:42.605 15:34:46 -- host/target_disconnect.sh@65 -- # reconnectpid=823882 00:33:42.605 15:34:46 -- host/target_disconnect.sh@67 -- # sleep 2 00:33:42.605 15:34:46 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:33:42.605 EAL: No free 2048 kB hugepages reported on node 1 00:33:44.511 15:34:48 -- host/target_disconnect.sh@68 -- # kill -9 822797 00:33:44.511 15:34:48 -- host/target_disconnect.sh@70 -- # sleep 2 00:33:45.449 [2024-04-24 15:34:49.011502] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Read completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 Write completed with error (sct=0, sc=8) 00:33:45.449 starting I/O failed 00:33:45.449 [2024-04-24 15:34:49.012088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:45.449 [2024-04-24 15:34:49.013901] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:45.449 [2024-04-24 15:34:49.013919] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:45.449 [2024-04-24 15:34:49.013927] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:46.388 [2024-04-24 15:34:50.016599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:46.388 qpair failed and we were unable to recover it. 00:33:46.388 [2024-04-24 15:34:50.018214] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:46.388 [2024-04-24 15:34:50.018233] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:46.388 [2024-04-24 15:34:50.018242] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:46.388 /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 822797 Killed "${NVMF_APP[@]}" "$@" 00:33:46.388 15:34:50 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:33:46.388 15:34:50 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:46.388 15:34:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:46.388 15:34:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:46.388 15:34:50 -- common/autotest_common.sh@10 -- # set +x 00:33:46.388 15:34:50 -- nvmf/common.sh@470 -- # nvmfpid=824400 00:33:46.388 15:34:50 -- nvmf/common.sh@471 -- # waitforlisten 824400 00:33:46.388 15:34:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:46.388 15:34:50 -- common/autotest_common.sh@817 -- # '[' -z 824400 ']' 00:33:46.388 15:34:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:46.388 15:34:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:46.388 15:34:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:46.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:46.388 15:34:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:46.388 15:34:50 -- common/autotest_common.sh@10 -- # set +x 00:33:46.648 [2024-04-24 15:34:50.338509] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:33:46.648 [2024-04-24 15:34:50.338567] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:46.648 EAL: No free 2048 kB hugepages reported on node 1 00:33:46.648 [2024-04-24 15:34:50.434362] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:46.648 [2024-04-24 15:34:50.512404] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:46.648 [2024-04-24 15:34:50.512454] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:46.648 [2024-04-24 15:34:50.512464] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:46.648 [2024-04-24 15:34:50.512473] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:46.648 [2024-04-24 15:34:50.512481] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:46.648 [2024-04-24 15:34:50.512604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:46.648 [2024-04-24 15:34:50.512701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:46.648 [2024-04-24 15:34:50.512798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:46.648 [2024-04-24 15:34:50.512799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:47.216 [2024-04-24 15:34:51.020950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:47.216 qpair failed and we were unable to recover it. 00:33:47.216 [2024-04-24 15:34:51.022781] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:47.216 [2024-04-24 15:34:51.022801] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:47.216 [2024-04-24 15:34:51.022810] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:47.476 15:34:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:47.476 15:34:51 -- common/autotest_common.sh@850 -- # return 0 00:33:47.476 15:34:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:47.476 15:34:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 15:34:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:47.476 15:34:51 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 Malloc0 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 [2024-04-24 15:34:51.228198] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x16e9830/0x16e8e70) succeed. 00:33:47.476 [2024-04-24 15:34:51.239158] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x16eabe0/0x16e93f0) succeed. 00:33:47.476 [2024-04-24 15:34:51.239182] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 [2024-04-24 15:34:51.267450] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:33:47.476 15:34:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:47.476 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:33:47.476 15:34:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:47.476 15:34:51 -- host/target_disconnect.sh@73 -- # wait 823882 00:33:48.424 [2024-04-24 15:34:52.025479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:48.424 qpair failed and we were unable to recover it. 00:33:48.424 [2024-04-24 15:34:52.027240] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:48.424 [2024-04-24 15:34:52.027257] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:48.424 [2024-04-24 15:34:52.027266] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:49.366 [2024-04-24 15:34:53.029915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:49.366 qpair failed and we were unable to recover it. 00:33:49.366 [2024-04-24 15:34:53.031708] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:49.366 [2024-04-24 15:34:53.031726] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:49.366 [2024-04-24 15:34:53.031736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:50.303 [2024-04-24 15:34:54.034382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:50.303 qpair failed and we were unable to recover it. 00:33:50.303 [2024-04-24 15:34:54.036142] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:50.303 [2024-04-24 15:34:54.036159] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:50.303 [2024-04-24 15:34:54.036168] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:51.241 [2024-04-24 15:34:55.038825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:51.241 qpair failed and we were unable to recover it. 00:33:51.241 [2024-04-24 15:34:55.040648] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:51.241 [2024-04-24 15:34:55.040665] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:51.241 [2024-04-24 15:34:55.040673] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:52.178 [2024-04-24 15:34:56.043349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:52.178 qpair failed and we were unable to recover it. 00:33:52.178 [2024-04-24 15:34:56.045129] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:52.178 [2024-04-24 15:34:56.045148] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:52.178 [2024-04-24 15:34:56.045158] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:53.557 [2024-04-24 15:34:57.047805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:53.557 qpair failed and we were unable to recover it. 00:33:53.557 [2024-04-24 15:34:57.049571] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:53.557 [2024-04-24 15:34:57.049591] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:53.557 [2024-04-24 15:34:57.049600] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:54.493 [2024-04-24 15:34:58.052236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:54.493 qpair failed and we were unable to recover it. 00:33:54.752 [2024-04-24 15:34:58.612502] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Write completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 Read completed with error (sct=0, sc=8) 00:33:54.753 starting I/O failed 00:33:54.753 [2024-04-24 15:34:58.613042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:54.753 [2024-04-24 15:34:58.614842] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:54.753 [2024-04-24 15:34:58.614860] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:54.753 [2024-04-24 15:34:58.614869] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:56.130 [2024-04-24 15:34:59.617563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:56.130 qpair failed and we were unable to recover it. 00:33:56.130 [2024-04-24 15:34:59.619352] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:56.130 [2024-04-24 15:34:59.619372] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:56.130 [2024-04-24 15:34:59.619381] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:57.066 [2024-04-24 15:35:00.622092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:57.066 qpair failed and we were unable to recover it. 00:33:57.325 [2024-04-24 15:35:01.171500] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Write completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 Read completed with error (sct=0, sc=8) 00:33:57.325 starting I/O failed 00:33:57.325 [2024-04-24 15:35:01.172024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:57.325 [2024-04-24 15:35:01.173808] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:57.325 [2024-04-24 15:35:01.173825] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:57.325 [2024-04-24 15:35:01.173834] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:58.345 [2024-04-24 15:35:02.176537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:58.345 qpair failed and we were unable to recover it. 00:33:58.915 [2024-04-24 15:35:02.707499] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Write completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.915 Read completed with error (sct=0, sc=8) 00:33:58.915 starting I/O failed 00:33:58.916 Read completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Write completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Read completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Write completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Read completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Write completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Read completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Write completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Read completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 Write completed with error (sct=0, sc=8) 00:33:58.916 starting I/O failed 00:33:58.916 [2024-04-24 15:35:02.708049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:58.916 [2024-04-24 15:35:02.709804] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:58.916 [2024-04-24 15:35:02.709822] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:58.916 [2024-04-24 15:35:02.709831] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:59.852 [2024-04-24 15:35:03.712523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:59.852 qpair failed and we were unable to recover it. 00:33:59.852 [2024-04-24 15:35:03.714317] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:59.852 [2024-04-24 15:35:03.714336] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:59.852 [2024-04-24 15:35:03.714344] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:34:01.232 [2024-04-24 15:35:04.717026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:34:01.232 qpair failed and we were unable to recover it. 00:34:01.232 [2024-04-24 15:35:04.718937] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:34:01.232 [2024-04-24 15:35:04.718963] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:34:01.233 [2024-04-24 15:35:04.718973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:34:02.171 [2024-04-24 15:35:05.721653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:34:02.171 qpair failed and we were unable to recover it. 00:34:02.171 [2024-04-24 15:35:05.721729] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:34:02.171 A controller has encountered a failure and is being reset. 00:34:02.171 Resorting to new failover address 192.168.100.9 00:34:02.171 [2024-04-24 15:35:05.721826] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:34:02.171 [2024-04-24 15:35:05.721887] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:34:02.171 [2024-04-24 15:35:05.751434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:34:02.171 Controller properly reset. 00:34:02.171 Initializing NVMe Controllers 00:34:02.171 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:34:02.171 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:34:02.171 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:34:02.171 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:34:02.171 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:34:02.171 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:34:02.171 Initialization complete. Launching workers. 00:34:02.171 Starting thread on core 1 00:34:02.171 Starting thread on core 2 00:34:02.171 Starting thread on core 3 00:34:02.171 Starting thread on core 0 00:34:02.171 15:35:05 -- host/target_disconnect.sh@74 -- # sync 00:34:02.171 00:34:02.171 real 0m19.534s 00:34:02.171 user 0m59.611s 00:34:02.171 sys 0m7.192s 00:34:02.171 15:35:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:34:02.171 15:35:05 -- common/autotest_common.sh@10 -- # set +x 00:34:02.171 ************************************ 00:34:02.171 END TEST nvmf_target_disconnect_tc3 00:34:02.171 ************************************ 00:34:02.171 15:35:05 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:34:02.171 15:35:05 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:34:02.171 15:35:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:34:02.171 15:35:05 -- nvmf/common.sh@117 -- # sync 00:34:02.171 15:35:05 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:34:02.171 15:35:05 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:34:02.171 15:35:05 -- nvmf/common.sh@120 -- # set +e 00:34:02.171 15:35:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:34:02.171 15:35:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:34:02.171 rmmod nvme_rdma 00:34:02.171 rmmod nvme_fabrics 00:34:02.171 15:35:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:34:02.171 15:35:05 -- nvmf/common.sh@124 -- # set -e 00:34:02.171 15:35:05 -- nvmf/common.sh@125 -- # return 0 00:34:02.171 15:35:05 -- nvmf/common.sh@478 -- # '[' -n 824400 ']' 00:34:02.171 15:35:05 -- nvmf/common.sh@479 -- # killprocess 824400 00:34:02.171 15:35:05 -- common/autotest_common.sh@936 -- # '[' -z 824400 ']' 00:34:02.171 15:35:05 -- common/autotest_common.sh@940 -- # kill -0 824400 00:34:02.171 15:35:05 -- common/autotest_common.sh@941 -- # uname 00:34:02.171 15:35:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:34:02.171 15:35:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 824400 00:34:02.171 15:35:05 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:34:02.171 15:35:05 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:34:02.171 15:35:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 824400' 00:34:02.171 killing process with pid 824400 00:34:02.171 15:35:05 -- common/autotest_common.sh@955 -- # kill 824400 00:34:02.171 15:35:05 -- common/autotest_common.sh@960 -- # wait 824400 00:34:02.171 [2024-04-24 15:35:05.980016] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:34:02.431 15:35:06 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:34:02.431 15:35:06 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:34:02.431 00:34:02.431 real 0m42.075s 00:34:02.431 user 2m32.536s 00:34:02.431 sys 0m17.820s 00:34:02.431 15:35:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:34:02.431 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.431 ************************************ 00:34:02.431 END TEST nvmf_target_disconnect 00:34:02.431 ************************************ 00:34:02.431 15:35:06 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:34:02.431 15:35:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:02.431 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.431 15:35:06 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:34:02.431 00:34:02.431 real 26m0.038s 00:34:02.431 user 75m28.719s 00:34:02.431 sys 6m12.880s 00:34:02.431 15:35:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:34:02.431 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.431 ************************************ 00:34:02.431 END TEST nvmf_rdma 00:34:02.431 ************************************ 00:34:02.431 15:35:06 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:34:02.431 15:35:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:34:02.431 15:35:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:34:02.431 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.690 ************************************ 00:34:02.690 START TEST spdkcli_nvmf_rdma 00:34:02.690 ************************************ 00:34:02.690 15:35:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:34:02.690 * Looking for test storage... 00:34:02.690 * Found test storage at /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli 00:34:02.690 15:35:06 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/common.sh 00:34:02.690 15:35:06 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:34:02.690 15:35:06 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/json_config/clear_config.py 00:34:02.690 15:35:06 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/nvmf/common.sh 00:34:02.690 15:35:06 -- nvmf/common.sh@7 -- # uname -s 00:34:02.690 15:35:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:34:02.951 15:35:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:34:02.951 15:35:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:34:02.951 15:35:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:34:02.951 15:35:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:34:02.951 15:35:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:34:02.951 15:35:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:34:02.951 15:35:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:34:02.951 15:35:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:34:02.951 15:35:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:34:02.951 15:35:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80e71deb-ee4e-e711-906e-0012795d9712 00:34:02.951 15:35:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80e71deb-ee4e-e711-906e-0012795d9712 00:34:02.951 15:35:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:34:02.951 15:35:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:34:02.951 15:35:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:34:02.951 15:35:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:34:02.951 15:35:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:34:02.951 15:35:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:34:02.951 15:35:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:02.951 15:35:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:02.951 15:35:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:02.951 15:35:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:02.951 15:35:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:02.951 15:35:06 -- paths/export.sh@5 -- # export PATH 00:34:02.951 15:35:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:02.951 15:35:06 -- nvmf/common.sh@47 -- # : 0 00:34:02.951 15:35:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:34:02.951 15:35:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:34:02.951 15:35:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:34:02.951 15:35:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:34:02.951 15:35:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:34:02.951 15:35:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:34:02.951 15:35:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:34:02.951 15:35:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:34:02.951 15:35:06 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:34:02.951 15:35:06 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:34:02.951 15:35:06 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:34:02.951 15:35:06 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:34:02.951 15:35:06 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:02.951 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.951 15:35:06 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:34:02.951 15:35:06 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=826482 00:34:02.951 15:35:06 -- spdkcli/common.sh@34 -- # waitforlisten 826482 00:34:02.951 15:35:06 -- common/autotest_common.sh@817 -- # '[' -z 826482 ']' 00:34:02.951 15:35:06 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:34:02.951 15:35:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:34:02.951 15:35:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:34:02.951 15:35:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:34:02.951 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:34:02.951 15:35:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:34:02.951 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:34:02.951 [2024-04-24 15:35:06.679802] Starting SPDK v24.05-pre git sha1 3f2c89791 / DPDK 23.11.0 initialization... 00:34:02.951 [2024-04-24 15:35:06.679870] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid826482 ] 00:34:02.951 EAL: No free 2048 kB hugepages reported on node 1 00:34:02.951 [2024-04-24 15:35:06.759882] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:34:02.951 [2024-04-24 15:35:06.845937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:34:02.951 [2024-04-24 15:35:06.845940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:34:03.889 15:35:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:34:03.889 15:35:07 -- common/autotest_common.sh@850 -- # return 0 00:34:03.889 15:35:07 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:34:03.889 15:35:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:03.889 15:35:07 -- common/autotest_common.sh@10 -- # set +x 00:34:03.889 15:35:07 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:34:03.889 15:35:07 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:34:03.889 15:35:07 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:34:03.889 15:35:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:34:03.889 15:35:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:34:03.889 15:35:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:34:03.889 15:35:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:34:03.889 15:35:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:34:03.889 15:35:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:34:03.889 15:35:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:34:03.889 15:35:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:34:03.889 15:35:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:34:03.889 15:35:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:34:03.889 15:35:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:34:03.889 15:35:07 -- common/autotest_common.sh@10 -- # set +x 00:34:12.016 15:35:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:34:12.016 15:35:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:34:12.016 15:35:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:34:12.016 15:35:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:34:12.016 15:35:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:34:12.016 15:35:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:34:12.016 15:35:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:34:12.016 15:35:14 -- nvmf/common.sh@295 -- # net_devs=() 00:34:12.016 15:35:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:34:12.016 15:35:14 -- nvmf/common.sh@296 -- # e810=() 00:34:12.016 15:35:14 -- nvmf/common.sh@296 -- # local -ga e810 00:34:12.016 15:35:14 -- nvmf/common.sh@297 -- # x722=() 00:34:12.016 15:35:14 -- nvmf/common.sh@297 -- # local -ga x722 00:34:12.016 15:35:14 -- nvmf/common.sh@298 -- # mlx=() 00:34:12.016 15:35:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:34:12.016 15:35:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:34:12.016 15:35:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@327 -- # [[ e810 == mlx5 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@329 -- # [[ e810 == e810 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@330 -- # pci_devs=("${e810[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x8086 - 0x1592)' 00:34:12.016 Found 0000:18:00.0 (0x8086 - 0x1592) 00:34:12.016 15:35:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:34:12.016 15:35:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x8086 - 0x1592)' 00:34:12.016 Found 0000:18:00.1 (0x8086 - 0x1592) 00:34:12.016 15:35:14 -- nvmf/common.sh@342 -- # [[ ice == unknown ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@346 -- # [[ ice == unbound ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@350 -- # [[ 0x1592 == \0\x\1\0\1\7 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@351 -- # [[ 0x1592 == \0\x\1\0\1\9 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:34:12.016 15:35:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@372 -- # [[ e810 == e810 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@372 -- # [[ rdma == rdma ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@373 -- # [[ -e /sys/module/irdma/parameters/roce_ena ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@375 -- # (( 1 != 1 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@377 -- # modinfo irdma 00:34:12.016 15:35:14 -- nvmf/common.sh@377 -- # modprobe irdma roce_ena=1 00:34:12.016 15:35:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:12.016 15:35:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:12.016 15:35:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: cvl_0_0' 00:34:12.016 Found net devices under 0000:18:00.0: cvl_0_0 00:34:12.016 15:35:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:12.016 15:35:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:12.016 15:35:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: cvl_0_1' 00:34:12.016 Found net devices under 0000:18:00.1: cvl_0_1 00:34:12.016 15:35:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:34:12.016 15:35:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:34:12.016 15:35:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:34:12.016 15:35:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:34:12.016 15:35:14 -- nvmf/common.sh@58 -- # uname 00:34:12.016 15:35:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:34:12.016 15:35:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:34:12.016 15:35:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:34:12.016 15:35:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:34:12.016 15:35:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:34:12.016 15:35:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:34:12.016 15:35:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:34:12.016 15:35:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:34:12.016 15:35:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:34:12.016 15:35:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:34:12.016 15:35:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:34:12.016 15:35:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:34:12.016 15:35:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:34:12.016 15:35:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:34:12.016 15:35:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:34:12.016 15:35:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:34:12.016 15:35:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:34:12.016 15:35:14 -- nvmf/common.sh@105 -- # continue 2 00:34:12.016 15:35:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.016 15:35:14 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:34:12.016 15:35:14 -- nvmf/common.sh@105 -- # continue 2 00:34:12.016 15:35:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:34:12.016 15:35:14 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_0 00:34:12.016 15:35:14 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:34:12.016 15:35:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:34:12.016 15:35:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:12.016 15:35:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:12.016 15:35:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:34:12.016 15:35:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:34:12.016 15:35:14 -- nvmf/common.sh@81 -- # ip addr show cvl_0_0 00:34:12.016 8: cvl_0_0: mtu 1500 qdisc mq state UP group default qlen 1000 00:34:12.016 link/ether b4:96:91:a4:0a:60 brd ff:ff:ff:ff:ff:ff 00:34:12.016 altname enp24s0f0np0 00:34:12.016 altname ens785f0np0 00:34:12.016 inet 192.168.100.8/24 scope global cvl_0_0 00:34:12.016 valid_lft forever preferred_lft forever 00:34:12.016 inet6 fe80::b696:91ff:fea4:a60/64 scope link proto kernel_ll 00:34:12.016 valid_lft forever preferred_lft forever 00:34:12.016 15:35:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:34:12.016 15:35:15 -- nvmf/common.sh@74 -- # get_ip_address cvl_0_1 00:34:12.016 15:35:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:34:12.016 15:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:34:12.016 15:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:12.016 15:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:12.016 15:35:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:34:12.016 15:35:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:34:12.016 15:35:15 -- nvmf/common.sh@81 -- # ip addr show cvl_0_1 00:34:12.016 9: cvl_0_1: mtu 1500 qdisc mq state UP group default qlen 1000 00:34:12.016 link/ether b4:96:91:a4:0a:61 brd ff:ff:ff:ff:ff:ff 00:34:12.016 altname enp24s0f1np1 00:34:12.016 altname ens785f1np1 00:34:12.016 inet 192.168.100.9/24 scope global cvl_0_1 00:34:12.016 valid_lft forever preferred_lft forever 00:34:12.016 inet6 fe80::b696:91ff:fea4:a61/64 scope link proto kernel_ll 00:34:12.016 valid_lft forever preferred_lft forever 00:34:12.016 15:35:15 -- nvmf/common.sh@411 -- # return 0 00:34:12.016 15:35:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:34:12.017 15:35:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:34:12.017 15:35:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:34:12.017 15:35:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:34:12.017 15:35:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:34:12.017 15:35:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:34:12.017 15:35:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:34:12.017 15:35:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:34:12.017 15:35:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:34:12.017 15:35:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:34:12.017 15:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:12.017 15:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.017 15:35:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\1 ]] 00:34:12.017 15:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.017 15:35:15 -- nvmf/common.sh@103 -- # [[ cvl_0_0 == \c\v\l\_\0\_\0 ]] 00:34:12.017 15:35:15 -- nvmf/common.sh@104 -- # echo cvl_0_0 00:34:12.017 15:35:15 -- nvmf/common.sh@105 -- # continue 2 00:34:12.017 15:35:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:12.017 15:35:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:12.017 15:35:15 -- nvmf/common.sh@103 -- # [[ cvl_0_1 == \c\v\l\_\0\_\1 ]] 00:34:12.017 15:35:15 -- nvmf/common.sh@104 -- # echo cvl_0_1 00:34:12.017 15:35:15 -- nvmf/common.sh@105 -- # continue 2 00:34:12.017 15:35:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:34:12.017 15:35:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_0 00:34:12.017 15:35:15 -- nvmf/common.sh@112 -- # interface=cvl_0_0 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_0 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:12.017 15:35:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:34:12.017 15:35:15 -- nvmf/common.sh@87 -- # get_ip_address cvl_0_1 00:34:12.017 15:35:15 -- nvmf/common.sh@112 -- # interface=cvl_0_1 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show cvl_0_1 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:12.017 15:35:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:12.017 15:35:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:34:12.017 192.168.100.9' 00:34:12.017 15:35:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:34:12.017 192.168.100.9' 00:34:12.017 15:35:15 -- nvmf/common.sh@446 -- # head -n 1 00:34:12.017 15:35:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:34:12.017 15:35:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:34:12.017 192.168.100.9' 00:34:12.017 15:35:15 -- nvmf/common.sh@447 -- # tail -n +2 00:34:12.017 15:35:15 -- nvmf/common.sh@447 -- # head -n 1 00:34:12.017 15:35:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:34:12.017 15:35:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:34:12.017 15:35:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:34:12.017 15:35:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:34:12.017 15:35:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:34:12.017 15:35:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:34:12.017 15:35:15 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:34:12.017 15:35:15 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:34:12.017 15:35:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:12.017 15:35:15 -- common/autotest_common.sh@10 -- # set +x 00:34:12.017 15:35:15 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:34:12.017 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:34:12.017 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:34:12.017 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:34:12.017 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:34:12.017 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:34:12.017 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:34:12.017 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:12.017 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:12.017 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:34:12.017 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:34:12.017 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:34:12.017 ' 00:34:12.017 [2024-04-24 15:35:15.533122] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:34:13.924 [2024-04-24 15:35:17.601438] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f0(0x1d0c810/0x1d0be50) succeed. 00:34:13.924 [2024-04-24 15:35:17.611332] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device rocep24s0f1(0x1d0dbc0/0x1d0c3d0) succeed. 00:34:13.924 [2024-04-24 15:35:17.611358] rdma.c:2781:nvmf_rdma_create: *NOTICE*: Adjusting the io unit size to fit the device's maximum I/O size. New I/O unit size 24576 00:34:13.924 [2024-04-24 15:35:17.613578] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/1535 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:34:13.924 [2024-04-24 15:35:17.613608] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:34:13.924 [2024-04-24 15:35:17.614742] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:34:13.924 [2024-04-24 15:35:17.616525] iobuf.c: 323:spdk_iobuf_channel_init: *ERROR*: Failed to populate 'nvmf_RDMA' iobuf large buffer cache at 1024/1535 entries. You may need to increase spdk_iobuf_opts.large_pool_count (1024) 00:34:13.924 [2024-04-24 15:35:17.616541] iobuf.c: 326:spdk_iobuf_channel_init: *ERROR*: See scripts/calc-iobuf.py for guidance on how to calculate this value. 00:34:13.924 [2024-04-24 15:35:17.617701] transport.c: 629:nvmf_transport_poll_group_create: *ERROR*: Unable to reserve the full number of buffers for the pg buffer cache. 00:34:15.304 [2024-04-24 15:35:18.789616] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:34:17.213 [2024-04-24 15:35:20.960844] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:34:19.119 [2024-04-24 15:35:22.822883] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:34:20.500 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:34:20.500 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:34:20.500 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:20.500 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:20.500 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:34:20.500 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:34:20.500 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:34:20.500 15:35:24 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:34:20.500 15:35:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:20.500 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:34:20.760 15:35:24 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:34:20.760 15:35:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:20.760 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:34:20.760 15:35:24 -- spdkcli/nvmf.sh@69 -- # check_match 00:34:20.760 15:35:24 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:34:21.019 15:35:24 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:34:21.019 15:35:24 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:34:21.019 15:35:24 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:34:21.019 15:35:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:21.019 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:34:21.019 15:35:24 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:34:21.019 15:35:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:21.019 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:34:21.019 15:35:24 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:34:21.019 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:34:21.019 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:34:21.019 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:34:21.019 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:34:21.019 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:34:21.019 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:34:21.019 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:34:21.019 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:34:21.019 ' 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:34:26.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:34:26.292 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:34:26.292 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:34:26.292 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:34:26.292 15:35:29 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:34:26.292 15:35:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:26.292 15:35:29 -- common/autotest_common.sh@10 -- # set +x 00:34:26.292 15:35:29 -- spdkcli/nvmf.sh@90 -- # killprocess 826482 00:34:26.292 15:35:29 -- common/autotest_common.sh@936 -- # '[' -z 826482 ']' 00:34:26.292 15:35:29 -- common/autotest_common.sh@940 -- # kill -0 826482 00:34:26.292 15:35:29 -- common/autotest_common.sh@941 -- # uname 00:34:26.292 15:35:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:34:26.292 15:35:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 826482 00:34:26.292 15:35:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:34:26.292 15:35:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:34:26.292 15:35:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 826482' 00:34:26.292 killing process with pid 826482 00:34:26.292 15:35:29 -- common/autotest_common.sh@955 -- # kill 826482 00:34:26.292 [2024-04-24 15:35:29.940540] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:34:26.292 15:35:29 -- common/autotest_common.sh@960 -- # wait 826482 00:34:26.292 [2024-04-24 15:35:29.968585] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:34:26.292 15:35:30 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:34:26.292 15:35:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:34:26.292 15:35:30 -- nvmf/common.sh@117 -- # sync 00:34:26.292 15:35:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:34:26.292 15:35:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:34:26.292 15:35:30 -- nvmf/common.sh@120 -- # set +e 00:34:26.292 15:35:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:34:26.292 15:35:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:34:26.551 rmmod nvme_rdma 00:34:26.551 rmmod nvme_fabrics 00:34:26.551 15:35:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:34:26.551 15:35:30 -- nvmf/common.sh@124 -- # set -e 00:34:26.551 15:35:30 -- nvmf/common.sh@125 -- # return 0 00:34:26.551 15:35:30 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:34:26.551 15:35:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:34:26.551 15:35:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:34:26.551 00:34:26.551 real 0m23.765s 00:34:26.551 user 0m50.379s 00:34:26.551 sys 0m6.756s 00:34:26.551 15:35:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:34:26.551 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:34:26.551 ************************************ 00:34:26.551 END TEST spdkcli_nvmf_rdma 00:34:26.551 ************************************ 00:34:26.551 15:35:30 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:34:26.551 15:35:30 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:34:26.551 15:35:30 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:34:26.551 15:35:30 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:34:26.551 15:35:30 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:34:26.551 15:35:30 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:34:26.551 15:35:30 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:34:26.551 15:35:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:26.551 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:34:26.551 15:35:30 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:34:26.551 15:35:30 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:34:26.551 15:35:30 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:34:26.551 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:34:30.809 INFO: APP EXITING 00:34:30.809 INFO: killing all VMs 00:34:30.809 INFO: killing vhost app 00:34:30.809 INFO: EXIT DONE 00:34:34.101 Waiting for block devices as requested 00:34:34.101 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:34:34.101 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:34.101 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:34.101 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:34.360 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:34.360 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:34.360 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:34.619 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:34.619 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:34.619 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:34.619 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:34.878 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:34.878 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:34.878 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:35.138 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:35.138 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:35.138 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:38.449 Cleaning 00:34:38.449 Removing: /var/run/dpdk/spdk0/config 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:34:38.449 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:34:38.449 Removing: /var/run/dpdk/spdk0/hugepage_info 00:34:38.449 Removing: /var/run/dpdk/spdk1/config 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:34:38.449 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:34:38.450 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:34:38.450 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:34:38.450 Removing: /var/run/dpdk/spdk1/hugepage_info 00:34:38.450 Removing: /var/run/dpdk/spdk1/mp_socket 00:34:38.450 Removing: /var/run/dpdk/spdk2/config 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:34:38.450 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:34:38.450 Removing: /var/run/dpdk/spdk2/hugepage_info 00:34:38.450 Removing: /var/run/dpdk/spdk3/config 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:34:38.450 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:34:38.450 Removing: /var/run/dpdk/spdk3/hugepage_info 00:34:38.450 Removing: /var/run/dpdk/spdk4/config 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:34:38.450 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:34:38.450 Removing: /var/run/dpdk/spdk4/hugepage_info 00:34:38.450 Removing: /dev/shm/bdevperf_trace.pid739222 00:34:38.450 Removing: /dev/shm/bdev_svc_trace.1 00:34:38.450 Removing: /dev/shm/nvmf_trace.0 00:34:38.450 Removing: /dev/shm/spdk_tgt_trace.pid489191 00:34:38.450 Removing: /var/run/dpdk/spdk0 00:34:38.450 Removing: /var/run/dpdk/spdk1 00:34:38.450 Removing: /var/run/dpdk/spdk2 00:34:38.450 Removing: /var/run/dpdk/spdk3 00:34:38.450 Removing: /var/run/dpdk/spdk4 00:34:38.450 Removing: /var/run/dpdk/spdk_pid486606 00:34:38.450 Removing: /var/run/dpdk/spdk_pid487797 00:34:38.450 Removing: /var/run/dpdk/spdk_pid489191 00:34:38.450 Removing: /var/run/dpdk/spdk_pid489848 00:34:38.450 Removing: /var/run/dpdk/spdk_pid490661 00:34:38.450 Removing: /var/run/dpdk/spdk_pid490852 00:34:38.450 Removing: /var/run/dpdk/spdk_pid491625 00:34:38.450 Removing: /var/run/dpdk/spdk_pid491799 00:34:38.450 Removing: /var/run/dpdk/spdk_pid492099 00:34:38.450 Removing: /var/run/dpdk/spdk_pid496968 00:34:38.450 Removing: /var/run/dpdk/spdk_pid498319 00:34:38.450 Removing: /var/run/dpdk/spdk_pid498580 00:34:38.450 Removing: /var/run/dpdk/spdk_pid498965 00:34:38.450 Removing: /var/run/dpdk/spdk_pid499226 00:34:38.450 Removing: /var/run/dpdk/spdk_pid499519 00:34:38.450 Removing: /var/run/dpdk/spdk_pid499782 00:34:38.450 Removing: /var/run/dpdk/spdk_pid500048 00:34:38.450 Removing: /var/run/dpdk/spdk_pid500286 00:34:38.450 Removing: /var/run/dpdk/spdk_pid501073 00:34:38.450 Removing: /var/run/dpdk/spdk_pid503427 00:34:38.450 Removing: /var/run/dpdk/spdk_pid503728 00:34:38.450 Removing: /var/run/dpdk/spdk_pid504024 00:34:38.450 Removing: /var/run/dpdk/spdk_pid504144 00:34:38.450 Removing: /var/run/dpdk/spdk_pid504603 00:34:38.450 Removing: /var/run/dpdk/spdk_pid504775 00:34:38.450 Removing: /var/run/dpdk/spdk_pid505179 00:34:38.450 Removing: /var/run/dpdk/spdk_pid505355 00:34:38.450 Removing: /var/run/dpdk/spdk_pid505572 00:34:38.450 Removing: /var/run/dpdk/spdk_pid505750 00:34:38.450 Removing: /var/run/dpdk/spdk_pid505960 00:34:38.450 Removing: /var/run/dpdk/spdk_pid506088 00:34:38.450 Removing: /var/run/dpdk/spdk_pid506580 00:34:38.450 Removing: /var/run/dpdk/spdk_pid506803 00:34:38.450 Removing: /var/run/dpdk/spdk_pid507052 00:34:38.450 Removing: /var/run/dpdk/spdk_pid507282 00:34:38.450 Removing: /var/run/dpdk/spdk_pid507476 00:34:38.450 Removing: /var/run/dpdk/spdk_pid507617 00:34:38.450 Removing: /var/run/dpdk/spdk_pid507925 00:34:38.720 Removing: /var/run/dpdk/spdk_pid508136 00:34:38.720 Removing: /var/run/dpdk/spdk_pid508340 00:34:38.720 Removing: /var/run/dpdk/spdk_pid508543 00:34:38.720 Removing: /var/run/dpdk/spdk_pid508763 00:34:38.720 Removing: /var/run/dpdk/spdk_pid509082 00:34:38.720 Removing: /var/run/dpdk/spdk_pid509316 00:34:38.720 Removing: /var/run/dpdk/spdk_pid509517 00:34:38.720 Removing: /var/run/dpdk/spdk_pid509728 00:34:38.720 Removing: /var/run/dpdk/spdk_pid509927 00:34:38.720 Removing: /var/run/dpdk/spdk_pid510164 00:34:38.720 Removing: /var/run/dpdk/spdk_pid510480 00:34:38.720 Removing: /var/run/dpdk/spdk_pid510702 00:34:38.720 Removing: /var/run/dpdk/spdk_pid510906 00:34:38.720 Removing: /var/run/dpdk/spdk_pid511108 00:34:38.720 Removing: /var/run/dpdk/spdk_pid511319 00:34:38.720 Removing: /var/run/dpdk/spdk_pid511604 00:34:38.720 Removing: /var/run/dpdk/spdk_pid511887 00:34:38.720 Removing: /var/run/dpdk/spdk_pid512089 00:34:38.720 Removing: /var/run/dpdk/spdk_pid512377 00:34:38.720 Removing: /var/run/dpdk/spdk_pid512659 00:34:38.720 Removing: /var/run/dpdk/spdk_pid512936 00:34:38.720 Removing: /var/run/dpdk/spdk_pid517196 00:34:38.720 Removing: /var/run/dpdk/spdk_pid589988 00:34:38.720 Removing: /var/run/dpdk/spdk_pid593922 00:34:38.720 Removing: /var/run/dpdk/spdk_pid601684 00:34:38.720 Removing: /var/run/dpdk/spdk_pid606422 00:34:38.720 Removing: /var/run/dpdk/spdk_pid609978 00:34:38.720 Removing: /var/run/dpdk/spdk_pid610512 00:34:38.720 Removing: /var/run/dpdk/spdk_pid623899 00:34:38.720 Removing: /var/run/dpdk/spdk_pid624231 00:34:38.720 Removing: /var/run/dpdk/spdk_pid628575 00:34:38.720 Removing: /var/run/dpdk/spdk_pid633927 00:34:38.720 Removing: /var/run/dpdk/spdk_pid636020 00:34:38.720 Removing: /var/run/dpdk/spdk_pid645432 00:34:38.720 Removing: /var/run/dpdk/spdk_pid667930 00:34:38.720 Removing: /var/run/dpdk/spdk_pid671496 00:34:38.720 Removing: /var/run/dpdk/spdk_pid675990 00:34:38.720 Removing: /var/run/dpdk/spdk_pid702684 00:34:38.720 Removing: /var/run/dpdk/spdk_pid715398 00:34:38.720 Removing: /var/run/dpdk/spdk_pid737484 00:34:38.720 Removing: /var/run/dpdk/spdk_pid738345 00:34:38.720 Removing: /var/run/dpdk/spdk_pid739222 00:34:38.720 Removing: /var/run/dpdk/spdk_pid743271 00:34:38.720 Removing: /var/run/dpdk/spdk_pid750403 00:34:38.720 Removing: /var/run/dpdk/spdk_pid751131 00:34:38.720 Removing: /var/run/dpdk/spdk_pid751849 00:34:38.720 Removing: /var/run/dpdk/spdk_pid752626 00:34:38.720 Removing: /var/run/dpdk/spdk_pid752852 00:34:38.720 Removing: /var/run/dpdk/spdk_pid757120 00:34:38.720 Removing: /var/run/dpdk/spdk_pid757122 00:34:38.720 Removing: /var/run/dpdk/spdk_pid761423 00:34:38.720 Removing: /var/run/dpdk/spdk_pid761856 00:34:38.720 Removing: /var/run/dpdk/spdk_pid762296 00:34:38.720 Removing: /var/run/dpdk/spdk_pid762301 00:34:38.720 Removing: /var/run/dpdk/spdk_pid764947 00:34:38.720 Removing: /var/run/dpdk/spdk_pid766446 00:34:38.720 Removing: /var/run/dpdk/spdk_pid768007 00:34:38.720 Removing: /var/run/dpdk/spdk_pid769797 00:34:38.720 Removing: /var/run/dpdk/spdk_pid771196 00:34:38.720 Removing: /var/run/dpdk/spdk_pid772599 00:34:38.720 Removing: /var/run/dpdk/spdk_pid778259 00:34:38.720 Removing: /var/run/dpdk/spdk_pid778698 00:34:38.720 Removing: /var/run/dpdk/spdk_pid780909 00:34:38.720 Removing: /var/run/dpdk/spdk_pid781868 00:34:38.720 Removing: /var/run/dpdk/spdk_pid789684 00:34:38.720 Removing: /var/run/dpdk/spdk_pid791803 00:34:38.720 Removing: /var/run/dpdk/spdk_pid798310 00:34:38.720 Removing: /var/run/dpdk/spdk_pid798335 00:34:38.720 Removing: /var/run/dpdk/spdk_pid816358 00:34:38.720 Removing: /var/run/dpdk/spdk_pid816546 00:34:38.720 Removing: /var/run/dpdk/spdk_pid821870 00:34:38.720 Removing: /var/run/dpdk/spdk_pid822267 00:34:38.720 Removing: /var/run/dpdk/spdk_pid823882 00:34:38.720 Removing: /var/run/dpdk/spdk_pid826482 00:34:38.720 Clean 00:34:38.987 15:35:42 -- common/autotest_common.sh@1437 -- # return 0 00:34:38.987 15:35:42 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:34:38.987 15:35:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:38.987 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:34:38.987 15:35:42 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:34:38.987 15:35:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:38.987 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:34:38.987 15:35:42 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/timing.txt 00:34:38.987 15:35:42 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/udev.log ]] 00:34:38.987 15:35:42 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/udev.log 00:34:38.987 15:35:42 -- spdk/autotest.sh@389 -- # hash lcov 00:34:38.987 15:35:42 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:34:38.987 15:35:42 -- spdk/autotest.sh@391 -- # hostname 00:34:38.987 15:35:42 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk -t spdk-wfp-38 -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_test.info 00:34:39.253 geninfo: WARNING: invalid characters removed from testname! 00:34:57.351 15:35:58 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:34:57.610 15:36:01 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:34:59.533 15:36:03 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:35:00.912 15:36:04 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:35:02.818 15:36:06 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:35:04.198 15:36:07 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/cov_total.info 00:35:06.105 15:36:09 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:35:06.105 15:36:09 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/common.sh 00:35:06.105 15:36:09 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:35:06.105 15:36:09 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:35:06.105 15:36:09 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:35:06.105 15:36:09 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:06.105 15:36:09 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:06.105 15:36:09 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:06.105 15:36:09 -- paths/export.sh@5 -- $ export PATH 00:35:06.105 15:36:09 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:35:06.105 15:36:09 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output 00:35:06.105 15:36:09 -- common/autobuild_common.sh@435 -- $ date +%s 00:35:06.105 15:36:09 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1713965769.XXXXXX 00:35:06.105 15:36:09 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1713965769.jwdlL2 00:35:06.106 15:36:09 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:35:06.106 15:36:09 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:35:06.106 15:36:09 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/' 00:35:06.106 15:36:09 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp' 00:35:06.106 15:36:09 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:35:06.106 15:36:09 -- common/autobuild_common.sh@451 -- $ get_config_params 00:35:06.106 15:36:09 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:35:06.106 15:36:09 -- common/autotest_common.sh@10 -- $ set +x 00:35:06.106 15:36:09 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:35:06.106 15:36:09 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:35:06.106 15:36:09 -- pm/common@17 -- $ local monitor 00:35:06.106 15:36:09 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:06.106 15:36:09 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=841444 00:35:06.106 15:36:09 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:06.106 15:36:09 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=841445 00:35:06.106 15:36:09 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:06.106 15:36:09 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=841447 00:35:06.106 15:36:09 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:06.106 15:36:09 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=841449 00:35:06.106 15:36:09 -- pm/common@26 -- $ sleep 1 00:35:06.106 15:36:09 -- pm/common@21 -- $ date +%s 00:35:06.106 15:36:09 -- pm/common@21 -- $ date +%s 00:35:06.106 15:36:09 -- pm/common@21 -- $ date +%s 00:35:06.106 15:36:09 -- pm/common@21 -- $ date +%s 00:35:06.106 15:36:09 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713965769 00:35:06.106 15:36:09 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713965769 00:35:06.106 15:36:09 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713965769 00:35:06.106 15:36:09 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1713965769 00:35:06.106 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713965769_collect-cpu-load.pm.log 00:35:06.106 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713965769_collect-vmstat.pm.log 00:35:06.106 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713965769_collect-bmc-pm.bmc.pm.log 00:35:06.106 Redirecting to /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1713965769_collect-cpu-temp.pm.log 00:35:07.045 15:36:10 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:35:07.045 15:36:10 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j72 00:35:07.045 15:36:10 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:35:07.045 15:36:10 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:35:07.045 15:36:10 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:35:07.045 15:36:10 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:35:07.045 15:36:10 -- spdk/autopackage.sh@19 -- $ timing_finish 00:35:07.046 15:36:10 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:35:07.046 15:36:10 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:35:07.046 15:36:10 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/timing.txt 00:35:07.046 15:36:10 -- spdk/autopackage.sh@20 -- $ exit 0 00:35:07.046 15:36:10 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:35:07.046 15:36:10 -- pm/common@30 -- $ signal_monitor_resources TERM 00:35:07.046 15:36:10 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:35:07.046 15:36:10 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:07.046 15:36:10 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:35:07.046 15:36:10 -- pm/common@45 -- $ pid=841457 00:35:07.046 15:36:10 -- pm/common@52 -- $ sudo kill -TERM 841457 00:35:07.046 15:36:10 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:07.046 15:36:10 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:35:07.046 15:36:10 -- pm/common@45 -- $ pid=841463 00:35:07.046 15:36:10 -- pm/common@52 -- $ sudo kill -TERM 841463 00:35:07.046 15:36:10 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:07.046 15:36:10 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:35:07.046 15:36:10 -- pm/common@45 -- $ pid=841466 00:35:07.046 15:36:10 -- pm/common@52 -- $ sudo kill -TERM 841466 00:35:07.046 15:36:10 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:35:07.046 15:36:10 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:35:07.046 15:36:10 -- pm/common@45 -- $ pid=841465 00:35:07.046 15:36:10 -- pm/common@52 -- $ sudo kill -TERM 841465 00:35:07.046 + [[ -n 384757 ]] 00:35:07.046 + sudo kill 384757 00:35:07.056 [Pipeline] } 00:35:07.075 [Pipeline] // stage 00:35:07.081 [Pipeline] } 00:35:07.099 [Pipeline] // timeout 00:35:07.103 [Pipeline] } 00:35:07.120 [Pipeline] // catchError 00:35:07.125 [Pipeline] } 00:35:07.141 [Pipeline] // wrap 00:35:07.146 [Pipeline] } 00:35:07.161 [Pipeline] // catchError 00:35:07.169 [Pipeline] stage 00:35:07.171 [Pipeline] { (Epilogue) 00:35:07.185 [Pipeline] catchError 00:35:07.186 [Pipeline] { 00:35:07.199 [Pipeline] echo 00:35:07.201 Cleanup processes 00:35:07.207 [Pipeline] sh 00:35:07.496 + sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:35:07.496 841554 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/../output/power/sdr.cache 00:35:07.496 841783 sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:35:07.511 [Pipeline] sh 00:35:07.797 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk 00:35:07.797 ++ grep -v 'sudo pgrep' 00:35:07.797 ++ awk '{print $1}' 00:35:07.797 + sudo kill -9 841554 00:35:07.809 [Pipeline] sh 00:35:08.094 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:35:16.231 [Pipeline] sh 00:35:16.516 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:35:16.516 Artifacts sizes are good 00:35:16.532 [Pipeline] archiveArtifacts 00:35:16.549 Archiving artifacts 00:35:16.750 [Pipeline] sh 00:35:17.093 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-cvl-phy-autotest 00:35:17.109 [Pipeline] cleanWs 00:35:17.120 [WS-CLEANUP] Deleting project workspace... 00:35:17.120 [WS-CLEANUP] Deferred wipeout is used... 00:35:17.127 [WS-CLEANUP] done 00:35:17.129 [Pipeline] } 00:35:17.150 [Pipeline] // catchError 00:35:17.164 [Pipeline] sh 00:35:17.449 + logger -p user.info -t JENKINS-CI 00:35:17.459 [Pipeline] } 00:35:17.477 [Pipeline] // stage 00:35:17.483 [Pipeline] } 00:35:17.499 [Pipeline] // node 00:35:17.505 [Pipeline] End of Pipeline 00:35:17.545 Finished: SUCCESS